-- Logs begin at Mon 2022-09-19 11:13:56 UTC, end at Mon 2022-09-19 12:19:37 UTC. -- Sep 19 11:41:09.800618 dv-cinder-858293-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 11:41:09.809554 dv-cinder-858293-1-smb devstack@keystone.service[81405]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:41:09 2022] *** Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: nodename: dv-cinder-858293-1-smb Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: machine: x86_64 Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: clock source: unix Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: pcre jit disabled Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: detected number of CPU cores: 4 Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: current working directory: / Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:41:09.811574 dv-cinder-858293-1-smb devstack@keystone.service[81405]: your processes number limit is 47680 Sep 19 11:41:09.812163 dv-cinder-858293-1-smb devstack@keystone.service[81405]: your memory page size is 4096 bytes Sep 19 11:41:09.812163 dv-cinder-858293-1-smb devstack@keystone.service[81405]: detected max file descriptor number: 2048 Sep 19 11:41:09.812163 dv-cinder-858293-1-smb devstack@keystone.service[81405]: lock engine: pthread robust mutexes Sep 19 11:41:09.812163 dv-cinder-858293-1-smb devstack@keystone.service[81405]: thunder lock: enabled Sep 19 11:41:09.812163 dv-cinder-858293-1-smb devstack@keystone.service[81405]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 11:41:09.812163 dv-cinder-858293-1-smb devstack@keystone.service[81405]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:41:09.851157 dv-cinder-858293-1-smb devstack@keystone.service[81405]: Python main interpreter initialized at 0x55ffa2dc89c0 Sep 19 11:41:09.851157 dv-cinder-858293-1-smb devstack@keystone.service[81405]: python threads support enabled Sep 19 11:41:09.851157 dv-cinder-858293-1-smb devstack@keystone.service[81405]: your server socket listen backlog is limited to 100 connections Sep 19 11:41:09.851157 dv-cinder-858293-1-smb devstack@keystone.service[81405]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:41:09.851564 dv-cinder-858293-1-smb devstack@keystone.service[81405]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:41:09.851761 dv-cinder-858293-1-smb devstack@keystone.service[81405]: *** Operational MODE: preforking *** Sep 19 11:41:09.852003 dv-cinder-858293-1-smb devstack@keystone.service[81405]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:41:09.852003 dv-cinder-858293-1-smb devstack@keystone.service[81405]: spawned uWSGI master process (pid: 81405) Sep 19 11:41:09.852204 dv-cinder-858293-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 11:41:09.857182 dv-cinder-858293-1-smb devstack@keystone.service[81405]: spawned uWSGI worker 1 (pid: 81418, cores: 1) Sep 19 11:41:09.857182 dv-cinder-858293-1-smb devstack@keystone.service[81405]: spawned uWSGI worker 2 (pid: 81419, cores: 1) Sep 19 11:41:09.857182 dv-cinder-858293-1-smb devstack@keystone.service[81405]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:41:14.270633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:41:14.270633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: from cryptography.utils import int_from_bytes Sep 19 11:41:14.271438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:41:14.271438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: from cryptography.utils import int_from_bytes Sep 19 11:41:14.277761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:41:14.277761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: from cryptography.utils import int_from_bytes Sep 19 11:41:14.278297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:41:14.278297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: from cryptography.utils import int_from_bytes Sep 19 11:41:14.321286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:41:14.321466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:41:14.321655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] command line args: [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:41:14.321927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:41:14.322106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ================================================================================ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:41:14.322358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] admin_token = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.322603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config_dir = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.322789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.322972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] config_source = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.323151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] debug = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.323349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.324531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.324531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.324531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.324531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.324784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.324784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_config_append = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.324918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.325095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_dir = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.325301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.325538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.325728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:41:14.325814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.325967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:41:14.326092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.326169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] command line args: [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:41:14.326244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.326380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:41:14.326465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.326547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ================================================================================ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:41:14.326631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.326801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] admin_token = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.326879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.327045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.327125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] config_dir = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.327286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.327484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.327665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] config_source = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.327841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.327950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] debug = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.328093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.328213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.328381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.328495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.328638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.328752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.328897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] log_config_append = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] publish_errors = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] log_dir = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.329928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] log_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] standard_threads = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.330908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_journal = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_json = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_stderr = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] use_syslog = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.331885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.332032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.332111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.332288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.332378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.332527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.332605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.332787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.332876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.333026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.333295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.333381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.333462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] publish_errors = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.333535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.333695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.333777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.333924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.334008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.334086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.334225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.334315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.334473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.334557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.334722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.334806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] standard_threads = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.334955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.335045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.335199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.335276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.335385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.335495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.335575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] use_journal = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.335723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.335830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] use_json = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.335903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] use_stderr = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.336030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.336154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] use_syslog = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.336269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.336393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:41:14.336509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.336631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.336752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.336866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.336979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.337941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.338888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.339926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.340973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.341861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.342915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.343947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.344957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.345957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.346979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.347897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.348851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.349066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.349207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.349338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.349697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.349804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.349925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.350978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.351921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.352955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.353930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.354971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.355197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.355312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.355427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.355541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.355655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.355781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.355897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356240 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.356912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.357908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.external = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.358954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.password = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] auth.token = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.359895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.360994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.361118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.361287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.361413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.361530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.361648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.361763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.361878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.external = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.362956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.password = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] auth.token = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.363897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.364963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.365927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.366041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.366156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.366279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.366396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.366512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.366628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.366742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.367358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.367485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.367602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.367717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.367833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.367948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.368898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.369981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370576 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.370994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.371934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.372875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.373955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.374889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.375934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376758 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.376912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.377902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378378 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.378981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.379199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.379199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.379414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.379569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.379695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.379813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.379934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.380867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.381938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.382053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.382167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.382282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.382405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.383938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.384996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.385950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.386997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.387935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.388887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.389973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.390915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391147 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.391948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.392887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.393974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.394990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395337 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.395921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] role.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.396966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] role.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.397937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.398901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.399956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.400983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401834 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.401958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.402892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.403950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.404929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.405907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.406965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.407908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.408981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.409526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.410463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.410463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.410463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.410463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.410463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.410463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.410463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.411194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.411194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.411194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:41:14.411194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:41:14.436396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.436628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.436854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.437334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.437569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.437793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.445731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.446619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.473441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.473672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.474186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.474678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.528067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.528220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.576509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.576741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.577291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.577528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.733161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.733378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.733600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.733799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.733878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.734025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.734117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.734240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.734313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.734532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.734757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.734971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.758937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.759214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.759362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.759523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.759679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.759816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.759948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.760080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.760210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.760347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.760478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.760607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.760736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.760864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.771541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.771929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.784753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.784932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.785921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.786053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.786132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.786306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:41:14.802586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.802795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:41:14.803106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.803201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.803317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:41:14.803402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:41:14.803586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.803670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.803844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:41:14.803926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.804098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.804189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.804401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.804486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.804718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.804903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.814280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.814520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.814606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.814798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.814881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.815068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.815164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.815350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.822798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.823064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.825736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.826000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.826085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.826285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.826367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.826566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.826647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.826848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.826932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.827993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.828182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.828264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.828450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.828531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.828716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.852163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.852601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.853658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.853946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.854105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.854389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.858699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.858986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.859132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.859268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.859348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.859627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.865715 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.866004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.866096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.866288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.871760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.871953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.872070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.872248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.872358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.872535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.872652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.872822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.872936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.873087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.873212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.873385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.873508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.873653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.875540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.875671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.889627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.889911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.890038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.890238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.893730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.894127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.896910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.897228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.897375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.897675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.902063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.902467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.905123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.905762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.908316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.908615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.908902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.908984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.909212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.909296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.909496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.909592 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.909778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.909860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.910138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.910399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.925394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.925683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.925955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.926223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.926450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.926741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.927010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.927270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.933030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.934284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.934563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.935831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.936065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.936346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.937388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.937675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.939145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.939434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.939718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.940001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.940324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.940436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.940610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.940899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.941201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.941586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.952098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.952383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.952667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.952953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.953308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.953414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.953591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.953673 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.953874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.953956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.954155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.954535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.954816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.955091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.969892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.971119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.972801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.974069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.975971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.977256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.977455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.978717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.979027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.979308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.979697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.980169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.980449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.980851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.986085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.987262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.987548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.988726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:14.990475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.990872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.991158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.991434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.991628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.992544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.992862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.993196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:14.999768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:15.000059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.000350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.001021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:15.001334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.001620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.007259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:15.008085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.008368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.008740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.009031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.009178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:41:15.009328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.009467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.009601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.009745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.009876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.010974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.011089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.011249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.011369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.011518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.011639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.011830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.012105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.012370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.012677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:41:15.045906 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ffa2dc89c0 pid: 81419 (default app) Sep 19 11:41:15.046746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ffa2dc89c0 pid: 81418 (default app) Sep 19 11:41:15.049102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d60e9-62bb-4661-bb1d-5a3cc4417731 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:15.049416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d60e9-62bb-4661-bb1d-5a3cc4417731 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:15.049688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d60e9-62bb-4661-bb1d-5a3cc4417731 None None] PATH_INFO: `/v3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:15.053808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Mon Sep 19 11:41:15 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:21.863227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7291f-2a92-4bd7-9cd4-57ea5008ddf2 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:21.863727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7291f-2a92-4bd7-9cd4-57ea5008ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:21.863834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7291f-2a92-4bd7-9cd4-57ea5008ddf2 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:21.868574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:41:21.874055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:21.874465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:21.874603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:21.944444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: INFO dbcounter [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] Registered counter for database keystone Sep 19 11:41:21.963811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG oslo_db.sqlalchemy.engines [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:41:21.970092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writer thread running {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:41:22.147953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG passlib.handlers.bcrypt [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81419) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 11:41:22.148354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG passlib.handlers.bcrypt [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81419) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 11:41:22.205914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:22.207453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:22.342118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 19 11:41:22.829736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7291f-2a92-4bd7-9cd4-57ea5008ddf2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:22.902414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: INFO dbcounter [None req-ffd7291f-2a92-4bd7-9cd4-57ea5008ddf2 None None] Registered counter for database keystone Sep 19 11:41:22.923377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG oslo_db.sqlalchemy.engines [None req-ffd7291f-2a92-4bd7-9cd4-57ea5008ddf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:41:22.929913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writer thread running {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:41:23.050647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7291f-2a92-4bd7-9cd4-57ea5008ddf2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:23.055013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006a53-b16e-4d59-9526-bcd26f090064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:23.055633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006a53-b16e-4d59-9526-bcd26f090064 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:23.055917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006a53-b16e-4d59-9526-bcd26f090064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:23.056190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006a53-b16e-4d59-9526-bcd26f090064 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:23.064306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006a53-b16e-4d59-9526-bcd26f090064 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:23.116382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28006a53-b16e-4d59-9526-bcd26f090064 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 11:41:23.116727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006a53-b16e-4d59-9526-bcd26f090064 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:23.126065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Sep 19 11:41:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:41:23.132629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:23.149835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04114-8c7a-489d-9aef-ad207179ecd0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:23.154209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c26720-8e81-4d2a-863e-aaf829ad529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:23.155315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c26720-8e81-4d2a-863e-aaf829ad529f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:23.155596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c26720-8e81-4d2a-863e-aaf829ad529f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:23.155875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c26720-8e81-4d2a-863e-aaf829ad529f admin admin] PATH_INFO: `/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:23.157500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c26720-8e81-4d2a-863e-aaf829ad529f admin admin] RBAC: Authorizing `identity:get_project(project_id=0ebed357f0fb4f07ab3944407cd5ccdc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:23.210720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING keystone.common.rbac_enforcer.enforcer [None req-08c26720-8e81-4d2a-863e-aaf829ad529f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 11:41:23.211019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c26720-8e81-4d2a-863e-aaf829ad529f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:23.215497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Mon Sep 19 11:41:23 2022] GET /identity/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:25.375690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86478a31-5318-4588-9558-95f7c00c1a6c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:25.376294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86478a31-5318-4588-9558-95f7c00c1a6c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:25.376388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86478a31-5318-4588-9558-95f7c00c1a6c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:25.381637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:25.387457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679e17-79dd-49d6-a2a0-28555aeddf2b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:25.387885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679e17-79dd-49d6-a2a0-28555aeddf2b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:25.388138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679e17-79dd-49d6-a2a0-28555aeddf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:25.408269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ed679e17-79dd-49d6-a2a0-28555aeddf2b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:25.409839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ed679e17-79dd-49d6-a2a0-28555aeddf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:25.418315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 11:41:25.693298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86478a31-5318-4588-9558-95f7c00c1a6c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:25.705724 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86478a31-5318-4588-9558-95f7c00c1a6c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:25.709860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf20f0-b5d6-4ab7-90c8-b66385afa416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:25.711197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf20f0-b5d6-4ab7-90c8-b66385afa416 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:25.711471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf20f0-b5d6-4ab7-90c8-b66385afa416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:25.711739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf20f0-b5d6-4ab7-90c8-b66385afa416 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:25.719224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf20f0-b5d6-4ab7-90c8-b66385afa416 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:25.720970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf20f0-b5d6-4ab7-90c8-b66385afa416 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:25.730593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Sep 19 11:41:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:41:25.735901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed679e17-79dd-49d6-a2a0-28555aeddf2b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:25.745129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed679e17-79dd-49d6-a2a0-28555aeddf2b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:25.749458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ab826-9b64-4519-8ad3-6de5abf1e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:25.750075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ab826-9b64-4519-8ad3-6de5abf1e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:25.750355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ab826-9b64-4519-8ad3-6de5abf1e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:25.750628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ab826-9b64-4519-8ad3-6de5abf1e6ab admin admin] PATH_INFO: `/v3/users/52cfabda91074225ac5581142c451796` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:25.751937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ab826-9b64-4519-8ad3-6de5abf1e6ab admin admin] RBAC: Authorizing `identity:get_user(user_id=52cfabda91074225ac5581142c451796)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:25.753799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ab826-9b64-4519-8ad3-6de5abf1e6ab admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:25.755310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Mon Sep 19 11:41:25 2022] GET /identity/v3/users/52cfabda91074225ac5581142c451796 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:27.974904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec46-5fee-41ff-8b83-f3030be774a4 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:27.975411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec46-5fee-41ff-8b83-f3030be774a4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:27.975411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bec46-5fee-41ff-8b83-f3030be774a4 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:27.977024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:41:27.982252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59f9e-7028-464b-88f6-22658498a5db None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:27.982647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59f9e-7028-464b-88f6-22658498a5db None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:27.982909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59f9e-7028-464b-88f6-22658498a5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.001379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-bfe59f9e-7028-464b-88f6-22658498a5db None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:28.002542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bfe59f9e-7028-464b-88f6-22658498a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:28.055291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39da7-74db-4895-9cc3-48059196aea2 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.055561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39da7-74db-4895-9cc3-48059196aea2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.055835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39da7-74db-4895-9cc3-48059196aea2 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.057143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:28.062081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.062360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.062631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.088374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:28.106528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG passlib.handlers.bcrypt [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81418) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 11:41:28.106928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG passlib.handlers.bcrypt [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81418) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 11:41:28.155675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:28.157268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:28.256235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:41:28.357274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59f9e-7028-464b-88f6-22658498a5db None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:28.381669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:28.468718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59f9e-7028-464b-88f6-22658498a5db None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:28.502972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:28.503609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.503888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.504160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.515300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:28.524560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:28.525529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:41:28.526337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:28.528022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:28.531244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:28.612634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:28.630422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdacf27-404e-4aff-b207-b1d6e7f56272 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:28.631636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecf923-ecd4-418b-a568-7479a3c2d134 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:28.633410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:28.670313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:28.671177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.671461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.671732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.671939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:28.672541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.672821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.673091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.673798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:28.674099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:28.675483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:28.687318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:28.692886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:28.739696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:28.741313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:28.790700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ead6a-64eb-42f5-b10b-baed40e3dfb1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:28.823922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:28.824548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.824826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.825099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] PATH_INFO: `/v3/users/52cfabda91074225ac5581142c451796` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.826271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] RBAC: Authorizing `identity:get_user(user_id=52cfabda91074225ac5581142c451796)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:28.827720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:28.829309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:28 2022] GET /identity/v3/users/52cfabda91074225ac5581142c451796 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:28.834591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:28.840323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:28.845914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:28.848634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:28.850780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:28.935120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b6a6-3038-4176-b763-8bcbf09d046b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:28.946477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0351-a191-477e-a928-70c0560d8845 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:28.968911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:28.969559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.969838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.970110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:28.971215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:28.972657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:28.974477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:28.980291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:28.980766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:28.981145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:28.981450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:28.981726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:29.000735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:29.002224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:41:29.020177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:29.021072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:41:29.022116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:41:29.022116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:41:29.022116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:29.022116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:41:29.027321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:29.059055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:29.078940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100a874-4aa6-456f-aaeb-442773a5f899 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:29.083692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:29.113000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310761b-e964-4fa3-8e19-553637a8805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:29.113637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310761b-e964-4fa3-8e19-553637a8805a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:29.113918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310761b-e964-4fa3-8e19-553637a8805a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:29.114191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310761b-e964-4fa3-8e19-553637a8805a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:29.114923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310761b-e964-4fa3-8e19-553637a8805a None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.domain.id=default, user.id=52cfabda91074225ac5581142c451796) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:29.115229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310761b-e964-4fa3-8e19-553637a8805a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:29.116779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310761b-e964-4fa3-8e19-553637a8805a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:29.123336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Sep 19 11:41:28 2022] GET /identity/v3/role_assignments?user.id=52cfabda91074225ac5581142c451796&scope.domain.id=default&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:29.133320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2644d13-983b-455c-9a45-7d5565b88ad1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:29.169923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ad7ae-1f4e-47bb-aac8-8ca6d44a4e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:29.170532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ad7ae-1f4e-47bb-aac8-8ca6d44a4e6c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:29.170809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ad7ae-1f4e-47bb-aac8-8ca6d44a4e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:29.171078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ad7ae-1f4e-47bb-aac8-8ca6d44a4e6c None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:29.171729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ad7ae-1f4e-47bb-aac8-8ca6d44a4e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:29.172047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ad7ae-1f4e-47bb-aac8-8ca6d44a4e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:29.173499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ad7ae-1f4e-47bb-aac8-8ca6d44a4e6c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:29.192532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:31.726653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dbeb4-cbf7-427c-8de4-44eaa2ee6d4b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:31.727140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dbeb4-cbf7-427c-8de4-44eaa2ee6d4b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:31.727629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dbeb4-cbf7-427c-8de4-44eaa2ee6d4b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:31.730227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:31.736544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8b5b-989c-4fe8-b9da-226a17ac0786 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:31.737038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8b5b-989c-4fe8-b9da-226a17ac0786 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:31.737552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8b5b-989c-4fe8-b9da-226a17ac0786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:31.777108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4f2e8b5b-989c-4fe8-b9da-226a17ac0786 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:31.779146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4f2e8b5b-989c-4fe8-b9da-226a17ac0786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:31.812213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a59b-79c3-4dea-a736-644c7e8db211 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:31.813095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a59b-79c3-4dea-a736-644c7e8db211 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:31.814056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99a59b-79c3-4dea-a736-644c7e8db211 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:31.816645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:41:31.824660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9c3c-bcc5-46ac-84e2-f84f9079f32d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:31.829959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9c3c-bcc5-46ac-84e2-f84f9079f32d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:31.830735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9c3c-bcc5-46ac-84e2-f84f9079f32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:31.882719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-df3a9c3c-bcc5-46ac-84e2-f84f9079f32d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:31.885097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-df3a9c3c-bcc5-46ac-84e2-f84f9079f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:31.925054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:32.009875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:32.481164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8b5b-989c-4fe8-b9da-226a17ac0786 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:32.530051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9c3c-bcc5-46ac-84e2-f84f9079f32d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:32.551123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:32.638091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8b5b-989c-4fe8-b9da-226a17ac0786 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:32.671379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:32.700040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9c3c-bcc5-46ac-84e2-f84f9079f32d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:32.715194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797cee-a42a-4db6-85e2-b14d221c6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:32.715841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797cee-a42a-4db6-85e2-b14d221c6fdf None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:32.716117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797cee-a42a-4db6-85e2-b14d221c6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:32.716386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797cee-a42a-4db6-85e2-b14d221c6fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:32.733431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70797cee-a42a-4db6-85e2-b14d221c6fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:32.734848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70797cee-a42a-4db6-85e2-b14d221c6fdf None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-70797cee-a42a-4db6-85e2-b14d221c6fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:41:32.761378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:32.762662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:41:32.763442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:41:32.763442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:41:32.763442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:32.764031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 12/26] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:32.770798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38c29a-675f-4928-9b1b-925e4e6c8921 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:32.771087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38c29a-675f-4928-9b1b-925e4e6c8921 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:32.771367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38c29a-675f-4928-9b1b-925e4e6c8921 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:32.772998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:32.774036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38c29a-675f-4928-9b1b-925e4e6c8921 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:32.778034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2e48-be2f-4f22-a488-08379a733a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:32.778650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2e48-be2f-4f22-a488-08379a733a05 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:32.778928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2e48-be2f-4f22-a488-08379a733a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:32.779200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2e48-be2f-4f22-a488-08379a733a05 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:32.779891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2e48-be2f-4f22-a488-08379a733a05 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:32.781311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2e48-be2f-4f22-a488-08379a733a05 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:32.920631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 15/28] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Sep 19 11:41:32 2022] POST /identity/v3/roles => generated 219 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:41:32.922102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aed07-6e16-4f9c-8b17-24b8cc090a55 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:32.922395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aed07-6e16-4f9c-8b17-24b8cc090a55 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:32.922670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aed07-6e16-4f9c-8b17-24b8cc090a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:32.959486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fa6aed07-6e16-4f9c-8b17-24b8cc090a55 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:32.961796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fa6aed07-6e16-4f9c-8b17-24b8cc090a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:32.961998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38c29a-675f-4928-9b1b-925e4e6c8921 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:32.981553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:33.034808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:33.035359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:33.035642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:33.035916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:33.036581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:33.037096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:33.038383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:33.064399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:33.070657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:33.138551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 16/30] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:33.270071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1004-65b8-4ecd-90ab-a4cec5c5457e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:33.321915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:33.322909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:33.323388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:33.323857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:33.324971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:33.326682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:33.336132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63270f-e7dd-4da7-b22a-a8c32ba0617b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:33.336427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63270f-e7dd-4da7-b22a-a8c32ba0617b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:33.336714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63270f-e7dd-4da7-b22a-a8c32ba0617b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:33.338173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 17/31] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:41:33.343561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eae48-55df-47f8-b74d-c2b741d8056a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:33.343858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eae48-55df-47f8-b74d-c2b741d8056a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:33.344126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eae48-55df-47f8-b74d-c2b741d8056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:33.366590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9c7eae48-55df-47f8-b74d-c2b741d8056a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:33.368159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9c7eae48-55df-47f8-b74d-c2b741d8056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:33.463315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 18/32] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:41:33.465569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:33.495177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 15/33] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:41:33 2022] POST /identity/v3/projects => generated 301 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:41:33.589168 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eae48-55df-47f8-b74d-c2b741d8056a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:33.732912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eae48-55df-47f8-b74d-c2b741d8056a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:33.773270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:33.773917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:33.774193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:33.774463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:33.789628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:33.794486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:33.795311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:41:33.796051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 19/34] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:33.802050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:33.814587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:33.822086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:33.897779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:33.953952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6939e-6633-4996-9ef2-ef076ac6f2af None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:33.954896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186a3d3-2804-4b1c-8b1a-a63089e848a6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:33.994946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3241-8a6f-489d-aa45-a5f5bba15afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:33.995827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3241-8a6f-489d-aa45-a5f5bba15afe None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:33.996242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3241-8a6f-489d-aa45-a5f5bba15afe None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:33.996647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3241-8a6f-489d-aa45-a5f5bba15afe None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:33.997208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997abb-f175-43ab-8768-5940a1d6f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:33.997676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3241-8a6f-489d-aa45-a5f5bba15afe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:33.998017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997abb-f175-43ab-8768-5940a1d6f224 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:33.998457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997abb-f175-43ab-8768-5940a1d6f224 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:33.998831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997abb-f175-43ab-8768-5940a1d6f224 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:33.999629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997abb-f175-43ab-8768-5940a1d6f224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:33.999931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3241-8a6f-489d-aa45-a5f5bba15afe None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.000116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997abb-f175-43ab-8768-5940a1d6f224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:34.002056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997abb-f175-43ab-8768-5940a1d6f224 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.014892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 20/35] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Sep 19 11:41:33 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:41:34.015500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 16/36] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:34.016256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90143316-09d3-46b0-9bfe-0e1fa798775e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.016687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914578-3fc5-4a3c-8542-df437d5c652f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.016850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90143316-09d3-46b0-9bfe-0e1fa798775e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.017208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90143316-09d3-46b0-9bfe-0e1fa798775e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.017321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914578-3fc5-4a3c-8542-df437d5c652f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.017580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a914578-3fc5-4a3c-8542-df437d5c652f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.018907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 21/37] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:34.021195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 17/38] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:34.023089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914578-3fc5-4a3c-8542-df437d5c652f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:34.025941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a50aa1-5771-47dd-a148-ef823c328ae7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.026228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a50aa1-5771-47dd-a148-ef823c328ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.026507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a50aa1-5771-47dd-a148-ef823c328ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.046495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-42a50aa1-5771-47dd-a148-ef823c328ae7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:34.047755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-42a50aa1-5771-47dd-a148-ef823c328ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:34.110391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:34.137230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 22/39] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:41:34.137230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caac57-a329-4864-baa1-fbaeb814ec0c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.137230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caac57-a329-4864-baa1-fbaeb814ec0c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.137230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caac57-a329-4864-baa1-fbaeb814ec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.155780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a914578-3fc5-4a3c-8542-df437d5c652f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:34.158242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d1caac57-a329-4864-baa1-fbaeb814ec0c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:34.159824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d1caac57-a329-4864-baa1-fbaeb814ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:34.204314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:34.204948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.205316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.205588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] PATH_INFO: `/v3/users/52cfabda91074225ac5581142c451796` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.207043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] RBAC: Authorizing `identity:get_user(user_id=52cfabda91074225ac5581142c451796)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:34.208478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.211908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 18/40] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:34 2022] GET /identity/v3/users/52cfabda91074225ac5581142c451796 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:34.215956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:34.219282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:34.251253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 23/41] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:34.332477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdd6f4-d178-4672-8385-0f4e91262e6f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:34.368338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:34.368970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.369278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.369554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.370780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:34.372212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.374038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 19/42] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:34.379460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caac57-a329-4864-baa1-fbaeb814ec0c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:34.417870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:34.431628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:34.486603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caac57-a329-4864-baa1-fbaeb814ec0c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:34.543484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2f3a1-2452-452a-92b5-a1424d54e455 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:34.579478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:34.580131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.580411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.580683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.581870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:34.583324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.585168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 20/43] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:34.585945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:34.626446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341352-4848-4d14-83be-de396c65a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:34.627101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341352-4848-4d14-83be-de396c65a517 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.627381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341352-4848-4d14-83be-de396c65a517 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.627655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341352-4848-4d14-83be-de396c65a517 None admin] PATH_INFO: `/v3/domains/default/users/52cfabda91074225ac5581142c451796/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.629613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341352-4848-4d14-83be-de396c65a517 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=52cfabda91074225ac5581142c451796, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:34.631062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341352-4848-4d14-83be-de396c65a517 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.646420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 24/44] 10.222.0.42 () {58 vars in 1361 bytes} [Mon Sep 19 11:41:34 2022] PUT /identity/v3/domains/default/users/52cfabda91074225ac5581142c451796/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:41:34.647961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341352-4848-4d14-83be-de396c65a517 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:34.671270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:34.694468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:34.698315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838075c-39d9-4066-9579-9b5d49ce877f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:34.742923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ffd41-5970-4de0-b410-255248f2859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:34.743556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ffd41-5970-4de0-b410-255248f2859b None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.743838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ffd41-5970-4de0-b410-255248f2859b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.744114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ffd41-5970-4de0-b410-255248f2859b None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.744812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ffd41-5970-4de0-b410-255248f2859b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:34.746256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ffd41-5970-4de0-b410-255248f2859b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.764486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 21/45] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Sep 19 11:41:34 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:41:34.780491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341352-4848-4d14-83be-de396c65a517 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:34.822898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c01e0-df4a-4ccd-a2de-ce8b361253a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:34.823535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c01e0-df4a-4ccd-a2de-ce8b361253a0 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:34.823866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c01e0-df4a-4ccd-a2de-ce8b361253a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:34.824146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c01e0-df4a-4ccd-a2de-ce8b361253a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:34.824839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c01e0-df4a-4ccd-a2de-ce8b361253a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:34.826481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c01e0-df4a-4ccd-a2de-ce8b361253a0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:34.861489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 25/46] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:41:34 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:41:36.853141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834bd5-aa2b-47ca-8f46-49b5107d388b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:36.853702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834bd5-aa2b-47ca-8f46-49b5107d388b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:36.853702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834bd5-aa2b-47ca-8f46-49b5107d388b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:36.855074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 22/47] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:36.860360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e004bce-5f07-469d-acdf-26f5d7b9f5f9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:36.860736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e004bce-5f07-469d-acdf-26f5d7b9f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:36.860917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e004bce-5f07-469d-acdf-26f5d7b9f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:36.879258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5e004bce-5f07-469d-acdf-26f5d7b9f5f9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:36.880437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5e004bce-5f07-469d-acdf-26f5d7b9f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:36.951788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 26/48] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:37.025652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5a15-aee0-4f1c-9707-29f42fcca8b5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.025934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5a15-aee0-4f1c-9707-29f42fcca8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.026214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5a15-aee0-4f1c-9707-29f42fcca8b5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.027567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 23/49] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:37.032922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a637-c9d5-42c7-8b20-77af5303cee2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.033245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a637-c9d5-42c7-8b20-77af5303cee2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.033527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a637-c9d5-42c7-8b20-77af5303cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.051303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0b24a637-c9d5-42c7-8b20-77af5303cee2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:37.052486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0b24a637-c9d5-42c7-8b20-77af5303cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:37.063621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:37.120273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 27/50] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:37.216917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba5a15-aee0-4f1c-9707-29f42fcca8b5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:37.321708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba5a15-aee0-4f1c-9707-29f42fcca8b5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:37.355388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:37.356009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.356287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.356557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.360134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:37.370558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:37.376569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:37.377615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:37.378358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 24/51] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:37.383542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a637-c9d5-42c7-8b20-77af5303cee2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:37.398967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:37.486929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a637-c9d5-42c7-8b20-77af5303cee2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:37.499920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd6129-593d-4726-9436-a8d2523f7b96 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:37.520161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:37.520793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.521075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.521391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.522612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:37.522913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:37.524333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:37.532346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 28/52] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:37.533281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:37.533905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.534183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.534452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.535590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:37.537033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:37.538790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:37.542148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 25/53] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:37.544547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:37.551911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:37.606087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:37.641394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953417b-be2b-45f4-8401-e8723d9a368b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:37.643576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdb6e4-195a-4f07-a895-ce89e3c92ace None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:37.679241 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:37.679866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.680117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:37.680218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.680402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] PATH_INFO: `/v3/users/52cfabda91074225ac5581142c451796` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.680728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.681010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.681326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.681569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] RBAC: Authorizing `identity:get_user(user_id=52cfabda91074225ac5581142c451796)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:37.681983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:37.683017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:37.683420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:37.684600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:37 2022] GET /identity/v3/users/52cfabda91074225ac5581142c451796 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:37.689930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:37.712419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 26/55] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Sep 19 11:41:37 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:41:37.777693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:37.802175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2116-349d-4d2f-a7a6-4c85ff2dd033 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:37.838397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f446709-62b0-4c1b-a784-87d8441c251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:37.839056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446709-62b0-4c1b-a784-87d8441c251b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:37.839338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446709-62b0-4c1b-a784-87d8441c251b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:37.839611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446709-62b0-4c1b-a784-87d8441c251b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:37.840776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f446709-62b0-4c1b-a784-87d8441c251b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:37.842258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f446709-62b0-4c1b-a784-87d8441c251b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:37.843856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:37.850293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:37.954504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d92f7-92f1-417d-802c-5e3933ca02d3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:38.074381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:38.095233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f884e-4c1f-43bd-b82d-b2ed945c4897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:38.095851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f884e-4c1f-43bd-b82d-b2ed945c4897 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:38.096133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f884e-4c1f-43bd-b82d-b2ed945c4897 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:38.096407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f884e-4c1f-43bd-b82d-b2ed945c4897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:38.097139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f884e-4c1f-43bd-b82d-b2ed945c4897 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.domain.id=default, user.id=52cfabda91074225ac5581142c451796) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:38.097478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f884e-4c1f-43bd-b82d-b2ed945c4897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:38.098921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f884e-4c1f-43bd-b82d-b2ed945c4897 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:38.108295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 27/57] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Sep 19 11:41:37 2022] GET /identity/v3/role_assignments?user.id=52cfabda91074225ac5581142c451796&scope.domain.id=default&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 530 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:39.873302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0502b-deeb-4d04-8187-8ae62644eb61 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:39.873807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0502b-deeb-4d04-8187-8ae62644eb61 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:39.873893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0502b-deeb-4d04-8187-8ae62644eb61 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:39.875238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:39.880392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ee50c-2bce-4800-a238-43e051e36a4f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:39.880779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ee50c-2bce-4800-a238-43e051e36a4f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:39.880947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ee50c-2bce-4800-a238-43e051e36a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:39.899587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7b4ee50c-2bce-4800-a238-43e051e36a4f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:39.901113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7b4ee50c-2bce-4800-a238-43e051e36a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:39.966014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:40.235067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0502b-deeb-4d04-8187-8ae62644eb61 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:40.335376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0502b-deeb-4d04-8187-8ae62644eb61 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:40.368993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95892040-76bd-46e6-9e9f-c3e87a1b2c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:40.369643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892040-76bd-46e6-9e9f-c3e87a1b2c6f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:40.369923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892040-76bd-46e6-9e9f-c3e87a1b2c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:40.370196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892040-76bd-46e6-9e9f-c3e87a1b2c6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:40.371315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95892040-76bd-46e6-9e9f-c3e87a1b2c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:40.372770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95892040-76bd-46e6-9e9f-c3e87a1b2c6f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:40.374355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:40.379823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ee50c-2bce-4800-a238-43e051e36a4f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:40.477598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ee50c-2bce-4800-a238-43e051e36a4f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:40.487668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:40.510715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844e38-b139-4603-bea3-900dd684e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:40.511311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844e38-b139-4603-bea3-900dd684e2b1 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:40.511588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844e38-b139-4603-bea3-900dd684e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:40.511857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844e38-b139-4603-bea3-900dd684e2b1 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:40.512504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844e38-b139-4603-bea3-900dd684e2b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:40.513962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844e38-b139-4603-bea3-900dd684e2b1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:40.542305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:41:40 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:41:43.780323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ebe1-5b58-4231-bfec-9d1bc579a02e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:43.781386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ebe1-5b58-4231-bfec-9d1bc579a02e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:43.781871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ebe1-5b58-4231-bfec-9d1bc579a02e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:43.783714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:43.790550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192d49-5656-4829-8baa-f104c17960d5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:43.791443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192d49-5656-4829-8baa-f104c17960d5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:43.791917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192d49-5656-4829-8baa-f104c17960d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:43.817329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-49192d49-5656-4829-8baa-f104c17960d5 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:43.819445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-49192d49-5656-4829-8baa-f104c17960d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:43.922499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:41:43.998476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b1d2-30b4-48b6-9c26-9590e8e2847a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:43.999113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b1d2-30b4-48b6-9c26-9590e8e2847a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:43.999584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b1d2-30b4-48b6-9c26-9590e8e2847a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.001517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 34/64] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:44.007183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcdbb-b033-4882-a08d-4e11c3b52a72 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.007744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcdbb-b033-4882-a08d-4e11c3b52a72 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.008238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcdbb-b033-4882-a08d-4e11c3b52a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.034058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-cd5fcdbb-b033-4882-a08d-4e11c3b52a72 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:44.035596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cd5fcdbb-b033-4882-a08d-4e11c3b52a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:44.076319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d752-1010-4629-b1ca-3ecb15c8d83a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.076919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d752-1010-4629-b1ca-3ecb15c8d83a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.077430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d752-1010-4629-b1ca-3ecb15c8d83a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.078988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 35/65] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:44.083917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e0a8-d189-4799-85cd-c839432de3c0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.085064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e0a8-d189-4799-85cd-c839432de3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.085560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e0a8-d189-4799-85cd-c839432de3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.114354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-91e6e0a8-d189-4799-85cd-c839432de3c0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:44.117705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-91e6e0a8-d189-4799-85cd-c839432de3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:44.136701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:44.164407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 31/66] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:44.208435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 36/67] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:41:44.350030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcdbb-b033-4882-a08d-4e11c3b52a72 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:44.388433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:44.456734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e0a8-d189-4799-85cd-c839432de3c0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:44.509557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcdbb-b033-4882-a08d-4e11c3b52a72 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:44.549746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28bd6f-4e52-4058-a6df-92f028781f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:44.550384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28bd6f-4e52-4058-a6df-92f028781f32 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.550669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28bd6f-4e52-4058-a6df-92f028781f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.550947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28bd6f-4e52-4058-a6df-92f028781f32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.566071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28bd6f-4e52-4058-a6df-92f028781f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fc28bd6f-4e52-4058-a6df-92f028781f32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:44.576895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:44.577794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:44.578533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:44.579113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 32/68] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:44.582051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f31be-e8ba-4428-a21c-7cd16bcc60b7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.582342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f31be-e8ba-4428-a21c-7cd16bcc60b7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.582618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f31be-e8ba-4428-a21c-7cd16bcc60b7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.588371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 33/69] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:44.588371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f31be-e8ba-4428-a21c-7cd16bcc60b7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:44.600871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e0a8-d189-4799-85cd-c839432de3c0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:44.641290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:44.641933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.642430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.642777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.654564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:44.659756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:44.660809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:41:44.661774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:41:44.664294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 37/70] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:41:44.665089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:44.671555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:44.696987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:44.714966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f31be-e8ba-4428-a21c-7cd16bcc60b7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:44.751942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9757a1b-cb6f-4d07-86b6-d75ed8fc4b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:44.752575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757a1b-cb6f-4d07-86b6-d75ed8fc4b9a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.752851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757a1b-cb6f-4d07-86b6-d75ed8fc4b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.753125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757a1b-cb6f-4d07-86b6-d75ed8fc4b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.764341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9757a1b-cb6f-4d07-86b6-d75ed8fc4b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f9757a1b-cb6f-4d07-86b6-d75ed8fc4b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:44.769520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:44.770541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:44.771385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 34/71] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:44.772227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f079-abc4-467d-98c9-dcb3dbeff807 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.772227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f079-abc4-467d-98c9-dcb3dbeff807 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.772362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f079-abc4-467d-98c9-dcb3dbeff807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.776333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c45280-0d03-4d7b-8fe7-7e6372818909 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:44.790275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-33f7f079-abc4-467d-98c9-dcb3dbeff807 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:44.791495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-33f7f079-abc4-467d-98c9-dcb3dbeff807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:44.812401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:44.813011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.813326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.813602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.814272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:44.814580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:44.815969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:44.824363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 38/72] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:44.825162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:44.858151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 35/73] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:44.859401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4702e4-d949-410b-a28c-ca56559fba45 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.859688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4702e4-d949-410b-a28c-ca56559fba45 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.859973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4702e4-d949-410b-a28c-ca56559fba45 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.861373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 36/74] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:44.861914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4702e4-d949-410b-a28c-ca56559fba45 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:44.902560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:44.943971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d8af5-dbef-4c74-a6a5-7e9c5f1b0afc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:44.949510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:44.978363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4702e4-d949-410b-a28c-ca56559fba45 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:44.981726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:44.982341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.982623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.982899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.983574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:44.983972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:44.985389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:44.994001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 39/75] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:44.994807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.018654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665bcb6-693a-4b55-8226-3bd5c7da13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.019716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665bcb6-693a-4b55-8226-3bd5c7da13a4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.020003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665bcb6-693a-4b55-8226-3bd5c7da13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.020282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665bcb6-693a-4b55-8226-3bd5c7da13a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.021109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665bcb6-693a-4b55-8226-3bd5c7da13a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:45.021457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665bcb6-693a-4b55-8226-3bd5c7da13a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.023090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665bcb6-693a-4b55-8226-3bd5c7da13a4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.031793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:45.033090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7913a-8864-408d-99bb-0ac148e8ab04 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.033341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7913a-8864-408d-99bb-0ac148e8ab04 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.033618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7913a-8864-408d-99bb-0ac148e8ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.051099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-47a7913a-8864-408d-99bb-0ac148e8ab04 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:45.052285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-47a7913a-8864-408d-99bb-0ac148e8ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:45.105236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6431f-e3c4-4723-97e3-ca8e874547c0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.123998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 38/77] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:45.125116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7913a-8864-408d-99bb-0ac148e8ab04 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.140397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.150794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.151428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.151712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.151986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.166380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.167927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.170311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 40/78] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:45.170983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.202721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.242120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7913a-8864-408d-99bb-0ac148e8ab04 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.278066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ebca4-3b68-415f-89b5-659a05fc06c6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.281024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.281860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.282296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.282704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.284001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.285775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.288876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 39/79] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:45.289832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.313571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.314205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.314483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.314755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] PATH_INFO: `/v3/users/52cfabda91074225ac5581142c451796` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.315885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] RBAC: Authorizing `identity:get_user(user_id=52cfabda91074225ac5581142c451796)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.317359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.324206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 41/80] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/users/52cfabda91074225ac5581142c451796 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:45.324206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.376468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.405778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d7865-9908-4321-a5ee-36eb088910dc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.424577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082503af-4cb1-4650-967c-0c3ce82bc1c1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.444067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.444703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.444983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.446531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.449259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.457857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:45.459685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.460455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.460740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.461016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:45.463424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:45.464422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 40/81] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:45.465371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.533356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.534799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.563386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a2a69-f6b9-47b1-b58f-3616ba9d753a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.585169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.597337 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.598060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.598211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.598480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.633332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 42/82] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:45.634174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.661075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.668985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.670465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.735684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49413a9-f121-4bee-b2eb-873361352e30 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.768760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 41/83] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:45.769644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.770597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.771205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.771515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.771786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.793540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.839501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.840975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.864814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:45.871538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5e1c-d374-4cc2-b607-822b1b251319 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:45.905025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:45.905676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:45.905958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:45.906232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:45.907339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:45.908790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:45.910551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 42/84] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:45.911204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.940819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 43/85] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:45.941555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:45.993351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:46.013392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942e2b8-20b5-4477-8889-ac815d93aae2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.039153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bc44a-34af-49d5-a206-60af3758b130 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.047273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.047821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.048105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.048380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.049041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:46.049392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.051148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.059684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 43/86] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.061614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.073346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.073981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.074261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.074536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.075662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.077183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.078742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 44/87] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:45 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.079482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.089881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:46.163224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645caf8-44e6-4905-97f7-23fdc151ab73 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.182222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b8ac9-c8fd-40d3-aced-46e45bebf4d5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.196481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.197112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.197422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.197700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.198827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.200274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.201886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:46.202006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 44/88] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:46 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.202695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.220376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.220979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.221284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.221559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.222203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.223626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.251038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 45/89] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:41:46 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:41:46.251845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.315425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:46.324727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ff075-0efd-45ae-a2bf-267c608e48ae None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.364883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbdeb-6d0e-46dc-b37f-682769bf8c58 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.366506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.367215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.367498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.367774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.368979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.370472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.372334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 45/90] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:46 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.373079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.409605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.410257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.410533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.410808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.412553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.414105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.420296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 46/91] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:46 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.420296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.477634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:46.502365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e744bec-c1e0-44ca-b6b3-034f68e65ba9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.549522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.550146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.550428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.550707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.551444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=d47f075f137044fd9b08529f463da346) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:46.551763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.553354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.557227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55667b7-59c0-4c5d-a3f0-0bc2c4c80b45 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.562653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 46/92] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:41:46 2022] GET /identity/v3/role_assignments?user.id=d47f075f137044fd9b08529f463da346&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.563635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.604113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:46.610864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.611608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.611900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.612253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.613328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] RBAC: Adding query filter params (role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=d47f075f137044fd9b08529f463da346) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:46.613643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.616230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.622083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 47/93] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:41:46 2022] GET /identity/v3/role_assignments?user.id=d47f075f137044fd9b08529f463da346&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.623043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:46.715536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe3291-ca27-4c19-a292-0a8a5f0ae733 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.751457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699270f-4dd3-40e2-bb4c-637cc9b921ad None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:46.759827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.760459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.760743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.761022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.762466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=52cfabda91074225ac5581142c451796) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:46.762466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.763794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.765555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:46.774406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 47/94] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:41:46 2022] GET /identity/v3/role_assignments?user.id=52cfabda91074225ac5581142c451796&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:46.799237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:46.800274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:46.800850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:46.801357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:46.881788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:46.884139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:46.998526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 48/95] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:47.004011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:47.133873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:47.147669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036a133-07fb-4c82-aa32-2ae49d2a18ba None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:47.188831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad530-cf8b-456a-9276-282f4eff0c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:47.189507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad530-cf8b-456a-9276-282f4eff0c17 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:47.189784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad530-cf8b-456a-9276-282f4eff0c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:47.190056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad530-cf8b-456a-9276-282f4eff0c17 None admin] PATH_INFO: `/v3/projects/586f72e2a7b642169f7da583ba3508a5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:47.191209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bad530-cf8b-456a-9276-282f4eff0c17 None admin] RBAC: Authorizing `identity:get_project(project_id=586f72e2a7b642169f7da583ba3508a5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:47.192650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bad530-cf8b-456a-9276-282f4eff0c17 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:47.194338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:47 2022] GET /identity/v3/projects/586f72e2a7b642169f7da583ba3508a5 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:47.200469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:47.217492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:47.325630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ecf23-e22a-45c0-a49e-a56e94d21281 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:47.368415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247eb5d8-7f62-408b-89b4-341c69df3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:47.369030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eb5d8-7f62-408b-89b4-341c69df3f9e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:47.369335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eb5d8-7f62-408b-89b4-341c69df3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:47.369610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eb5d8-7f62-408b-89b4-341c69df3f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:47.370356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247eb5d8-7f62-408b-89b4-341c69df3f9e None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=586f72e2a7b642169f7da583ba3508a5, user.id=d47f075f137044fd9b08529f463da346) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:47.370664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247eb5d8-7f62-408b-89b4-341c69df3f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:47.372113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247eb5d8-7f62-408b-89b4-341c69df3f9e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:47.378064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 49/97] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:41:47 2022] GET /identity/v3/role_assignments?user.id=d47f075f137044fd9b08529f463da346&scope.project.id=586f72e2a7b642169f7da583ba3508a5&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:49.511549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00191b-a424-4a09-8788-cf228cb43b9a None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:49.512059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00191b-a424-4a09-8788-cf228cb43b9a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:49.512059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00191b-a424-4a09-8788-cf228cb43b9a None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:49.513593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 49/98] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:49.518590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4149f6-9c37-4c27-8203-3af31260b7aa None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:49.518973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4149f6-9c37-4c27-8203-3af31260b7aa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:49.519150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4149f6-9c37-4c27-8203-3af31260b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:49.544693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3e4149f6-9c37-4c27-8203-3af31260b7aa None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:49.545918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3e4149f6-9c37-4c27-8203-3af31260b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:49.573805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b149d-6bc8-4df7-bfe2-b2c7cd6c26b4 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:49.574151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b149d-6bc8-4df7-bfe2-b2c7cd6c26b4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:49.574429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b149d-6bc8-4df7-bfe2-b2c7cd6c26b4 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:49.575876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 50/99] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:41:49.581866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1e02-6aec-4e04-88c1-bbd436a84fd7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:49.582311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1e02-6aec-4e04-88c1-bbd436a84fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:49.582723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1e02-6aec-4e04-88c1-bbd436a84fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:49.611811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5d0c1e02-6aec-4e04-88c1-bbd436a84fd7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:49.618682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5d0c1e02-6aec-4e04-88c1-bbd436a84fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:49.692351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 50/100] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:49.757109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 51/101] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:49.825815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289d6d-a701-43d0-a9c2-9bffb416eb36 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:49.826442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289d6d-a701-43d0-a9c2-9bffb416eb36 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:49.826971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289d6d-a701-43d0-a9c2-9bffb416eb36 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:49.828768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 51/102] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:49.833833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd292-8e6f-4099-b25e-b854dc20124a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:49.834341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd292-8e6f-4099-b25e-b854dc20124a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:49.834822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd292-8e6f-4099-b25e-b854dc20124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:49.862130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-dd5fd292-8e6f-4099-b25e-b854dc20124a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:49.863641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-dd5fd292-8e6f-4099-b25e-b854dc20124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:49.952047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 52/103] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:50.097023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82289d6d-a701-43d0-a9c2-9bffb416eb36 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:50.101162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:50.230828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82289d6d-a701-43d0-a9c2-9bffb416eb36 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:50.246357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd292-8e6f-4099-b25e-b854dc20124a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:50.280275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce237917-1dde-499f-8e10-f8a0c6ae2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:50.280911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237917-1dde-499f-8e10-f8a0c6ae2777 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.281205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237917-1dde-499f-8e10-f8a0c6ae2777 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.281480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce237917-1dde-499f-8e10-f8a0c6ae2777 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.283330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce237917-1dde-499f-8e10-f8a0c6ae2777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:50.283854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:50.284793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce237917-1dde-499f-8e10-f8a0c6ae2777 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:50.287202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 52/104] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:50.288555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441128-38a0-4808-8354-f019c88ff208 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.288834 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441128-38a0-4808-8354-f019c88ff208 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.289106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441128-38a0-4808-8354-f019c88ff208 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.298189 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 53/105] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:50.299087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441128-38a0-4808-8354-f019c88ff208 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:50.430096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:50.432526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd292-8e6f-4099-b25e-b854dc20124a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:50.470824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441128-38a0-4808-8354-f019c88ff208 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:50.471766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad736d3b-c709-4560-88ef-7c9c7cee8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:50.472414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736d3b-c709-4560-88ef-7c9c7cee8ddf None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.472782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736d3b-c709-4560-88ef-7c9c7cee8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.472964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736d3b-c709-4560-88ef-7c9c7cee8ddf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.485256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad736d3b-c709-4560-88ef-7c9c7cee8ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ad736d3b-c709-4560-88ef-7c9c7cee8ddf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:50.491722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:50.492594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:50.493764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 53/106] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:41:50.494594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061beb4a-a7f8-4bc0-8ebc-c70c7fab1844 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.494767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061beb4a-a7f8-4bc0-8ebc-c70c7fab1844 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.495041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061beb4a-a7f8-4bc0-8ebc-c70c7fab1844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.512928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-061beb4a-a7f8-4bc0-8ebc-c70c7fab1844 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:50.513771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:50.514327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-061beb4a-a7f8-4bc0-8ebc-c70c7fab1844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:50.514426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.514654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.514925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.515571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:50.517036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:50.544986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 54/107] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:41:50 2022] POST /identity/v3/projects => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:41:50.545858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:50.605757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 54/108] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:50.607776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf53b4-5ed8-44a3-92d3-e538a9258245 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.608075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf53b4-5ed8-44a3-92d3-e538a9258245 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.608360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf53b4-5ed8-44a3-92d3-e538a9258245 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.610504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 55/109] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:50.611514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf53b4-5ed8-44a3-92d3-e538a9258245 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:50.649180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:50.695105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bc12-f741-459d-95df-49d069de7b09 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:50.728980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:50.745671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7f028-1cd7-4fc3-b644-d8c71d3a1095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:50.746769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7f028-1cd7-4fc3-b644-d8c71d3a1095 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.747211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7f028-1cd7-4fc3-b644-d8c71d3a1095 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.747997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7f028-1cd7-4fc3-b644-d8c71d3a1095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.754862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf53b4-5ed8-44a3-92d3-e538a9258245 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:50.763262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7f028-1cd7-4fc3-b644-d8c71d3a1095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7dd7f028-1cd7-4fc3-b644-d8c71d3a1095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:50.770110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:50.771198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:41:50.772406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:41:50.773813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 55/110] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:41:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:50.774897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4c8cc-9ad1-4ce8-a763-71d43689aa32 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.775178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4c8cc-9ad1-4ce8-a763-71d43689aa32 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.775448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4c8cc-9ad1-4ce8-a763-71d43689aa32 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.776834 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 56/111] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:50.779408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa7a7-91ca-4cdd-9db2-e016b5d8c4eb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.779408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa7a7-91ca-4cdd-9db2-e016b5d8c4eb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.779408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa7a7-91ca-4cdd-9db2-e016b5d8c4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.798308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0f3fa7a7-91ca-4cdd-9db2-e016b5d8c4eb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:50.799323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0f3fa7a7-91ca-4cdd-9db2-e016b5d8c4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:50.806995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:50.807613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.807899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.808179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.808849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:50.809177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:50.810603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:50.821040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 56/112] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:50.821778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:50.875695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 57/113] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:50.876857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be873c9-52da-486e-8b1d-2bd8d20ba01b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:50.877163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be873c9-52da-486e-8b1d-2bd8d20ba01b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:50.877454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be873c9-52da-486e-8b1d-2bd8d20ba01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:50.895936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1be873c9-52da-486e-8b1d-2bd8d20ba01b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:50.897376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1be873c9-52da-486e-8b1d-2bd8d20ba01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:50.911385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:50.949449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38ffdc-824f-4b6f-98de-2cd0798bdea0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:50.987709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 58/114] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:50.988376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be873c9-52da-486e-8b1d-2bd8d20ba01b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.003332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.004250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.004745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.005269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.006184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:51.006729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.009074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.027029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 57/115] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:41:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:51.031016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.086476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:51.178046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be873c9-52da-486e-8b1d-2bd8d20ba01b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.193494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab205b-c7ff-4f34-b01c-1ecaf069a2c9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.229574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:51.232789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.233905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.234977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.235462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.235563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.236183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.236780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.237144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.237560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.239416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.246855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 59/116] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:50 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:51.246855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.258876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:51.265875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:51.266883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:41:51.267773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:51.269764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 58/117] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:51.270823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.364755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0528dd-8497-4cf2-a206-8fbda54fa115 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.377309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:51.386214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00068c-8819-4321-8e6d-ba4ca5cc98bb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.403200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.403947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.404227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.404500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.405652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.407211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.408947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 60/118] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:51.409690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.427093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.428012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.428318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.428668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.440078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:51.445648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:51.446498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 59/119] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:51.449996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.510649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:51.522621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4edc7e-d966-4b5e-82e7-4d63040e9bc0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.558802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.559436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.559693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.559961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.560057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63610afa-dead-45f9-b88a-88f808b1b69f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.561137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.563030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.564210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 61/120] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:51.564973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.598570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.600100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.600401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.600641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.601558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:51.601871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.603295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.612746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 60/121] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:51.617273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.625435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:51.683302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189309b-c4b0-4106-a1ca-2a9b591ccce0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.723036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.723664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.724203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.724580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.730640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c435257-28ce-4cde-8a0b-27aa69db850f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.734649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:51.739471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:51.740903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:41:51.741690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 62/122] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:51.742316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.748419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:51.770077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.770772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.771057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.771949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.773121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.774606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.776426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 61/123] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:51.781647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.850848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e79355-fb2c-4be2-8855-0cbe9f4e555c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.859852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:51.883269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105108-f812-4ea5-8518-0943a006efa4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:51.889564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.890285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.890566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.890840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.891508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:51.891813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.893339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.905444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 63/124] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:51.906064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:51.922327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:51.922997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:51.923282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:51.923563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/d47f075f137044fd9b08529f463da346/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:51.925561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac517b9e9caf41319a6fd497a84e8420, user_id=d47f075f137044fd9b08529f463da346, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:51.927029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:51.945076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 62/125] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:41:51 2022] PUT /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/d47f075f137044fd9b08529f463da346/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:41:51.958252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.024613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae6dd-f355-45f9-80ed-786d0b518cba None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.028306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.069740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.070492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.070778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.071106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] PATH_INFO: `/v3/users/1c70cc157d9e42589b3d12e1e9b61268` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.090097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] RBAC: Authorizing `identity:get_user(user_id=1c70cc157d9e42589b3d12e1e9b61268)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.091607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.098546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 64/126] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/users/1c70cc157d9e42589b3d12e1e9b61268 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:52.100296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.116860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a44f3-6958-4376-8a1c-c0485f95df81 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.133196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.162272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.163092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.163378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.163772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.164451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:52.164759 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.166177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.176138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 63/127] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:52.176935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.228182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202b52-92c5-4a3d-a377-c633827dba40 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.265325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.265988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.266266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.266539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/d47f075f137044fd9b08529f463da346/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.268696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac517b9e9caf41319a6fd497a84e8420, user_id=d47f075f137044fd9b08529f463da346, role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.270275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.286301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 65/128] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:41:52 2022] PUT /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/d47f075f137044fd9b08529f463da346/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:41:52.288415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.322001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578899a1-6465-46f3-8e02-26abc32100e1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.324679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.387042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.387696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.387977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.388248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.394078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.394991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.396582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.399578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 64/129] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:52 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:52.400442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.413623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdb652-8750-411c-9392-9d37b3223027 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.453605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.454273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.454563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.454984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.534385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.535936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.632178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd31a9-93c0-4c97-b7b9-dad3b53304fd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.639167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.650824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 66/130] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:52.657854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.712261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.712913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.713229 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.713510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] PATH_INFO: `/v3/users/52cfabda91074225ac5581142c451796` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.714766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] RBAC: Authorizing `identity:get_user(user_id=52cfabda91074225ac5581142c451796)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.716315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.717929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 65/131] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:52 2022] GET /identity/v3/users/52cfabda91074225ac5581142c451796 => generated 247 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:52.718992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.766754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.770843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8cba2-649c-4cff-b2dc-01ce6edf173b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.816186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.816888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.817185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.817465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] PATH_INFO: `/v3/projects/586f72e2a7b642169f7da583ba3508a5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.818820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] RBAC: Authorizing `identity:get_project(project_id=586f72e2a7b642169f7da583ba3508a5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.821365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.823062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 67/132] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:52 2022] GET /identity/v3/projects/586f72e2a7b642169f7da583ba3508a5 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:52.823847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.885969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbdfad-dafc-45f5-914a-f83d9d11b5fa None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.944342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.965608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.966595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.967064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.967567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.969197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.970830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.972865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 66/133] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:52 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:52.975242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:53.021781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80e396-ac96-42b6-9884-de66eefa788f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:53.060186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:53.060860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:53.061101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:53.061403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:53.062554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:53.064026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:53.066077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 68/134] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:52 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:53.066462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:53.130488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7fff3-2cad-4726-9c5e-12b3f378b677 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:53.140333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:53.167700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123bca1-cb4c-4336-82b4-35ef59dc5b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:53.168535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123bca1-cb4c-4336-82b4-35ef59dc5b32 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:53.168642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123bca1-cb4c-4336-82b4-35ef59dc5b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:53.168903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123bca1-cb4c-4336-82b4-35ef59dc5b32 None admin] PATH_INFO: `/v3/projects/586f72e2a7b642169f7da583ba3508a5/users/d47f075f137044fd9b08529f463da346/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:53.170987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123bca1-cb4c-4336-82b4-35ef59dc5b32 None admin] RBAC: Authorizing `identity:create_grant(project_id=586f72e2a7b642169f7da583ba3508a5, user_id=d47f075f137044fd9b08529f463da346, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:53.172497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123bca1-cb4c-4336-82b4-35ef59dc5b32 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:53.188394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 67/135] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:41:52 2022] PUT /identity/v3/projects/586f72e2a7b642169f7da583ba3508a5/users/d47f075f137044fd9b08529f463da346/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:41:53.189817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f771d-8848-4296-b931-f3d1e03ee094 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:53.190110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f771d-8848-4296-b931-f3d1e03ee094 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:53.190390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f771d-8848-4296-b931-f3d1e03ee094 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:53.191289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25b9e1-025c-4014-aca1-8e659a29a7a1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:53.193257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 68/136] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:53.194325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f771d-8848-4296-b931-f3d1e03ee094 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:53.222898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:53.239208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d54d3-abd4-4320-9059-c7b999b08019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:53.240446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d54d3-abd4-4320-9059-c7b999b08019 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:53.240909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d54d3-abd4-4320-9059-c7b999b08019 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:53.241489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d54d3-abd4-4320-9059-c7b999b08019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:53.242491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d54d3-abd4-4320-9059-c7b999b08019 None admin] RBAC: Adding query filter params (role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=1c70cc157d9e42589b3d12e1e9b61268) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:53.243003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d54d3-abd4-4320-9059-c7b999b08019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:53.244792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d54d3-abd4-4320-9059-c7b999b08019 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:53.251720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 69/137] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:41:53 2022] GET /identity/v3/role_assignments?user.id=1c70cc157d9e42589b3d12e1e9b61268&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:53.253614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f472-0437-4b61-9554-e7a41df88c14 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:53.254088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f472-0437-4b61-9554-e7a41df88c14 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:53.254564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892f472-0437-4b61-9554-e7a41df88c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:53.276420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3892f472-0437-4b61-9554-e7a41df88c14 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:53.278140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3892f472-0437-4b61-9554-e7a41df88c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:53.402763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f771d-8848-4296-b931-f3d1e03ee094 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:53.433539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 70/138] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:53.474994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:53.475879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:53.476162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:53.476440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/52cfabda91074225ac5581142c451796/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:53.478634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac517b9e9caf41319a6fd497a84e8420, user_id=52cfabda91074225ac5581142c451796, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:53.480120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:53.497890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:41:53 2022] PUT /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/52cfabda91074225ac5581142c451796/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:41:53.859975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f472-0437-4b61-9554-e7a41df88c14 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:53.999890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892f472-0437-4b61-9554-e7a41df88c14 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:54.023730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:54.043962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e7ea4-c1ac-4b70-81a9-94f0acb058d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:54.044599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7ea4-c1ac-4b70-81a9-94f0acb058d1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:54.044874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7ea4-c1ac-4b70-81a9-94f0acb058d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:54.045144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7ea4-c1ac-4b70-81a9-94f0acb058d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:54.046258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e7ea4-c1ac-4b70-81a9-94f0acb058d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:54.047734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e7ea4-c1ac-4b70-81a9-94f0acb058d1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:54.049466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 71/140] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:41:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:54.055336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:54.090844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:54.205731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02905-031e-4227-95c7-0b06a8d84512 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:54.252168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d41b5-b3b8-4b32-bd00-f1ccff3fc181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:54.252707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d41b5-b3b8-4b32-bd00-f1ccff3fc181 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:54.252987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d41b5-b3b8-4b32-bd00-f1ccff3fc181 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:54.253289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d41b5-b3b8-4b32-bd00-f1ccff3fc181 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:54.253948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d41b5-b3b8-4b32-bd00-f1ccff3fc181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:54.255483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d41b5-b3b8-4b32-bd00-f1ccff3fc181 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:54.280378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 70/141] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:41:54 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:41:54.685618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18bef-d223-4961-869a-a732e700edcd None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:54.685890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18bef-d223-4961-869a-a732e700edcd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:54.686342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18bef-d223-4961-869a-a732e700edcd None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:54.687523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 72/142] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:54.698899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b21cd6-93a8-43c9-87cf-b047313d32ce None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:54.699195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b21cd6-93a8-43c9-87cf-b047313d32ce None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:54.699474 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b21cd6-93a8-43c9-87cf-b047313d32ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:54.721866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-92b21cd6-93a8-43c9-87cf-b047313d32ce None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:54.723063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-92b21cd6-93a8-43c9-87cf-b047313d32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:54.812142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:55.390600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18bef-d223-4961-869a-a732e700edcd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:55.446526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a78d2-adc0-4c1b-837c-a4d6e616cc2c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:55.447044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a78d2-adc0-4c1b-837c-a4d6e616cc2c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:55.447044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a78d2-adc0-4c1b-837c-a4d6e616cc2c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:55.448418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 72/144] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:41:55.454096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72197ba-dfd3-4d3d-92ae-7fe54abfc3b8 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:55.454382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72197ba-dfd3-4d3d-92ae-7fe54abfc3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:55.454659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72197ba-dfd3-4d3d-92ae-7fe54abfc3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:55.480461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e72197ba-dfd3-4d3d-92ae-7fe54abfc3b8 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:55.481742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e72197ba-dfd3-4d3d-92ae-7fe54abfc3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:55.493523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:55.522151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18bef-d223-4961-869a-a732e700edcd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:55.581564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:55.582520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:55.582941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:55.583353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:55.605875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:55.611734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:55.612779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:41:55.613738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 73/145] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:55.621004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:55.622112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 73/146] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:41:55.709752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:55.775938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92499f-2867-425f-aa03-d040e903054d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:55.816954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:55.817592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:55.817921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:55.818199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:55.818876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:55.819176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:55.820553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:55.831421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 74/147] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:55.837761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72197ba-dfd3-4d3d-92ae-7fe54abfc3b8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:55.959532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72197ba-dfd3-4d3d-92ae-7fe54abfc3b8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:56.009674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:56.010676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:56.011177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:56.011667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:56.014926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:56.016612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:56.018466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 74/148] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:55 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:56.024928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:56.165552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a28ee-0115-4678-b877-51e1b0eac6d1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:56.174269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:56.202713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:56.203578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:56.203868 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:56.204139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:56.218835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:56.243698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:56.328471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:56.330432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:56.411845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93005a89-8636-4e24-ae64-cffff0c56028 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:56.479865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:56.481328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:56.481821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:56.482803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:56.506263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:56.512547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:56.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:41:56.514257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:56.517069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 75/149] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:41:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:56.526553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:56.549835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 75/150] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:56.557809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:56.570533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:56.641547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:56.692715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3a391-1bc3-414d-b851-7a78cc370722 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:56.758143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:56.759062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:56.759355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:56.759630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:56.760334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:56.760642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:56.762126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:56.775954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 76/151] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:41:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:56.782031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:56.810667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3a6f3-a9d2-4403-8de7-cbd5ab927f26 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:56.901897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60d021-0dfc-498f-9c30-b5650582306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:56.902552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60d021-0dfc-498f-9c30-b5650582306f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:56.902832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60d021-0dfc-498f-9c30-b5650582306f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:56.903104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60d021-0dfc-498f-9c30-b5650582306f None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:56.908135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60d021-0dfc-498f-9c30-b5650582306f None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:56.908135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60d021-0dfc-498f-9c30-b5650582306f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:56.909661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 76/152] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:56 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:56.913176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad2cb-a518-4e4a-a44f-b1731311775c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:56.913176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad2cb-a518-4e4a-a44f-b1731311775c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:56.913176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad2cb-a518-4e4a-a44f-b1731311775c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:56.913755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 77/153] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:56.914653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca596c1-f3e4-472e-a5a3-16178868acbf None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:56.914932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca596c1-f3e4-472e-a5a3-16178868acbf None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:56.915203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca596c1-f3e4-472e-a5a3-16178868acbf None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:56.916749 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 78/154] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:56.921898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca596c1-f3e4-472e-a5a3-16178868acbf None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:56.971362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0fbb6-d1b7-4dc4-a14e-5102e8cfd398 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:57.065492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:57.069867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0905f7-d437-44f4-873e-8f47bdd4aac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:57.070517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0905f7-d437-44f4-873e-8f47bdd4aac0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:57.070862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0905f7-d437-44f4-873e-8f47bdd4aac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:57.071214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0905f7-d437-44f4-873e-8f47bdd4aac0 None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:57.072338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0905f7-d437-44f4-873e-8f47bdd4aac0 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:57.073908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0905f7-d437-44f4-873e-8f47bdd4aac0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:57.075799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 77/155] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:56 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:57.076937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840f1b-d844-4d57-944c-719208539385 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:57.080544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840f1b-d844-4d57-944c-719208539385 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:57.080862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840f1b-d844-4d57-944c-719208539385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:57.088721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:57.110686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-83840f1b-d844-4d57-944c-719208539385 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:57.111882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-83840f1b-d844-4d57-944c-719208539385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:57.135913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca596c1-f3e4-472e-a5a3-16178868acbf None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:57.210034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8b3a6-598e-4e9f-8b8a-f79945bf8c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:57.210666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8b3a6-598e-4e9f-8b8a-f79945bf8c14 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:57.210943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8b3a6-598e-4e9f-8b8a-f79945bf8c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:57.211216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8b3a6-598e-4e9f-8b8a-f79945bf8c14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:57.211989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8b3a6-598e-4e9f-8b8a-f79945bf8c14 None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=d47f075f137044fd9b08529f463da346) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:57.212300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8b3a6-598e-4e9f-8b8a-f79945bf8c14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:57.213847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8b3a6-598e-4e9f-8b8a-f79945bf8c14 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:57.231104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 79/156] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:41:56 2022] GET /identity/v3/role_assignments?user.id=d47f075f137044fd9b08529f463da346&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:57.232389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e5497-75b7-48cd-a6d3-2de6fe8aea66 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:57.232669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e5497-75b7-48cd-a6d3-2de6fe8aea66 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:57.232938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e5497-75b7-48cd-a6d3-2de6fe8aea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:57.261272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 78/157] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:57.262171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83840f1b-d844-4d57-944c-719208539385 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:57.278616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-549e5497-75b7-48cd-a6d3-2de6fe8aea66 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:57.279863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-549e5497-75b7-48cd-a6d3-2de6fe8aea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:57.441660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 80/158] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:57.453810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9c3d-dc0b-4c6e-adb0-7d640fca6f7d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:57.454088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9c3d-dc0b-4c6e-adb0-7d640fca6f7d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:57.454608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9c3d-dc0b-4c6e-adb0-7d640fca6f7d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:57.456405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 81/159] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:57.462274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f892-c88e-4801-9468-c6310776d8e2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:57.462773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f892-c88e-4801-9468-c6310776d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:57.463191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f892-c88e-4801-9468-c6310776d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:57.488000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-70d6f892-c88e-4801-9468-c6310776d8e2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:57.489448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-70d6f892-c88e-4801-9468-c6310776d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:57.518873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83840f1b-d844-4d57-944c-719208539385 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:57.598301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:57.611605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:57.611605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:57.611605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:57.611605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:57.625516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:57.632390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 82/160] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:41:57.743301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:57.744680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:57.863546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 79/161] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:57.869144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6f892-c88e-4801-9468-c6310776d8e2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:57.914814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:57.974313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:58.035952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6f892-c88e-4801-9468-c6310776d8e2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:58.113884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:58.114590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:58.115486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:58.115973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:58.117230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:58.118778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:58.120036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b28ca4-eb96-41bc-aa3d-34f25da013bb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:58.120816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 83/162] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:57 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:58.126708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:58.190891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:58.191588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:58.191870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:58.192143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:58.206741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:58.212298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:58.213134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:41:58.213979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:58.216310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 80/163] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:58.217519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:58.263961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:58.340821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcd52-4e0d-4b68-af9b-e6f1ca82ab9d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:58.368085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:58.384560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a58a8-f84a-4c3c-aa1c-035aef20e26f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:58.409623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:58.410219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:58.410496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:58.410765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:58.412056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] RBAC: Adding query filter params (role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=d47f075f137044fd9b08529f463da346) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:58.412399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:58.413849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:58.437095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 84/164] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:41:58 2022] GET /identity/v3/role_assignments?user.id=d47f075f137044fd9b08529f463da346&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:41:58.438432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:58.443497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:58.444497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:58.444985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:58.445766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:58.481865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:58.486841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:58.487713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 81/165] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:58.490111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:58.638529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91c75-5dbd-43f5-ad7a-75855ac10beb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:58.710448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:58.731379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:58.732439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:58.732948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:58.733465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:58.734334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:58.734894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:58.736335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:58.754962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 85/166] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:58.757573 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:58.773779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d92c3-9a8b-4988-b495-27f49e8880af None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:58.816224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:58.817219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:58.817848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:58.818929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:58.830233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:41:58.835626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:41:58.836462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:41:58.837255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:41:58.840562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 82/167] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:41:58.841860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:58.860078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:58.942073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a4361-0622-4868-abe2-3c713c678e6e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:58.987193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabc137-304a-4d0c-8560-50e91ec07abd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:59.017942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.018636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.018922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.019199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.019897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:59.020230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.021978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.033773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 86/168] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:41:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:59.034723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.038601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a85e9-94f0-42f0-a6f0-6bb89f1a9be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.039253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a85e9-94f0-42f0-a6f0-6bb89f1a9be3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.039531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a85e9-94f0-42f0-a6f0-6bb89f1a9be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.039801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a85e9-94f0-42f0-a6f0-6bb89f1a9be3 None admin] PATH_INFO: `/v3/users/d47f075f137044fd9b08529f463da346` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.041018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a85e9-94f0-42f0-a6f0-6bb89f1a9be3 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f075f137044fd9b08529f463da346)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.042541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a85e9-94f0-42f0-a6f0-6bb89f1a9be3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.044225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 83/169] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:58 2022] GET /identity/v3/users/d47f075f137044fd9b08529f463da346 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:59.049690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96be2-386b-4d26-8d40-5fee5e54c7da None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.049998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96be2-386b-4d26-8d40-5fee5e54c7da None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.050257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96be2-386b-4d26-8d40-5fee5e54c7da None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.051981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 84/170] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:59.053360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b96be2-386b-4d26-8d40-5fee5e54c7da None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.116437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:59.150615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:59.175248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b96be2-386b-4d26-8d40-5fee5e54c7da None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:59.179043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7c18d-665f-4119-8c26-7c05123d11bf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:59.217916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3d445-b86c-4ff5-ada3-30effd5fc4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.218917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3d445-b86c-4ff5-ada3-30effd5fc4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.219475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3d445-b86c-4ff5-ada3-30effd5fc4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.220135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3d445-b86c-4ff5-ada3-30effd5fc4d2 None admin] PATH_INFO: `/v3/users/1c70cc157d9e42589b3d12e1e9b61268` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.220284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.220840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.221105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.221429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.222135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:41:59.222442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.223025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3d445-b86c-4ff5-ada3-30effd5fc4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=1c70cc157d9e42589b3d12e1e9b61268)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.224139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.225644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3d445-b86c-4ff5-ada3-30effd5fc4d2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.228268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 85/171] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:59 2022] GET /identity/v3/users/1c70cc157d9e42589b3d12e1e9b61268 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:59.234926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557343-149a-4115-a885-0c9376a1947a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.235360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557343-149a-4115-a885-0c9376a1947a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.235806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557343-149a-4115-a885-0c9376a1947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.236276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 87/172] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:59.236971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.259765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6b557343-149a-4115-a885-0c9376a1947a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:59.260973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6b557343-149a-4115-a885-0c9376a1947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:59.352691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 86/173] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:59.352691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0544-6644-4a59-8fec-b562d7657352 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.352691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0544-6644-4a59-8fec-b562d7657352 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.352691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0544-6644-4a59-8fec-b562d7657352 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.352691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 87/174] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:41:59.352691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff0544-6644-4a59-8fec-b562d7657352 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.396385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97ecf1-2733-4d13-af37-d8411a165000 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:59.422598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:59.447171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81f1b-3e3c-46f1-80f3-4ee898025ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.447884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81f1b-3e3c-46f1-80f3-4ee898025ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.448208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81f1b-3e3c-46f1-80f3-4ee898025ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.448560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81f1b-3e3c-46f1-80f3-4ee898025ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.454977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:59.488308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff0544-6644-4a59-8fec-b562d7657352 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:59.534662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.535626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.536169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.536843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.538336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.540171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.542251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 88/175] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:59 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:59.543588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.577504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81f1b-3e3c-46f1-80f3-4ee898025ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.579265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81f1b-3e3c-46f1-80f3-4ee898025ca6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.673695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566186c-49b0-4934-8054-a780d4ce3608 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:59.708231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 88/176] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:59.710381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56587f-6983-4786-bf31-46def345c396 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.710869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56587f-6983-4786-bf31-46def345c396 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.711335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56587f-6983-4786-bf31-46def345c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.718968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.718968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.719260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.719473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] PATH_INFO: `/v3/users/52cfabda91074225ac5581142c451796` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.720563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] RBAC: Authorizing `identity:get_user(user_id=52cfabda91074225ac5581142c451796)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.722033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.723632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 89/177] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:41:59 2022] GET /identity/v3/users/52cfabda91074225ac5581142c451796 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:41:59.725305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.735915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ff56587f-6983-4786-bf31-46def345c396 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:59.737485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ff56587f-6983-4786-bf31-46def345c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:59.750625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:59.750790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:59.812414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 89/178] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:59.814113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56587f-6983-4786-bf31-46def345c396 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.857919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9aa33-1395-457e-8712-bc9919d51a9c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:59.901508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:59.902476 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:59.902928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:59.903346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/1c70cc157d9e42589b3d12e1e9b61268/roles/7b9ede94d1c14a66b4ebd4cc6ca2ea90` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:59.905545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac517b9e9caf41319a6fd497a84e8420, user_id=1c70cc157d9e42589b3d12e1e9b61268, role_id=7b9ede94d1c14a66b4ebd4cc6ca2ea90)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:59.907329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:59.923211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 90/179] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:41:59 2022] PUT /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420/users/1c70cc157d9e42589b3d12e1e9b61268/roles/7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:41:59.927983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:59.950576 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56587f-6983-4786-bf31-46def345c396 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.004971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.007046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.007829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.008300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.027247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:00.033325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:00.034290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:00.035073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 90/180] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:41:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:00.035724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.036927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.050923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.075339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0489dc0-08c7-421c-b893-25b4ae9b8478 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.121719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaf46f-8806-4682-bbf8-0d1bb039bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.122362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf46f-8806-4682-bbf8-0d1bb039bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.122643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf46f-8806-4682-bbf8-0d1bb039bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.122910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaf46f-8806-4682-bbf8-0d1bb039bdc1 None admin] PATH_INFO: `/v3/projects/586f72e2a7b642169f7da583ba3508a5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.124110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaf46f-8806-4682-bbf8-0d1bb039bdc1 None admin] RBAC: Authorizing `identity:get_project(project_id=586f72e2a7b642169f7da583ba3508a5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:00.125609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaf46f-8806-4682-bbf8-0d1bb039bdc1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:00.132824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 91/181] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:41:59 2022] GET /identity/v3/projects/586f72e2a7b642169f7da583ba3508a5 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:00.132824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e93aa-34be-492a-a8bc-2473fc30db94 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.132824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e93aa-34be-492a-a8bc-2473fc30db94 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.132824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e93aa-34be-492a-a8bc-2473fc30db94 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.135131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 92/182] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:00.135878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e93aa-34be-492a-a8bc-2473fc30db94 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.174720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1280d43-b6bc-4d81-aeab-c2a111be30e4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.212294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.212899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.213199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.213465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.263843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e93aa-34be-492a-a8bc-2473fc30db94 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.283535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:00.284996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:00.292840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.300741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.301498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.301773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.302588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.303658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:00.303974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:00.305371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:00.314380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 93/183] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:00.318219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.322585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.395462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 91/184] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:00.397257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.432238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc357564-0e00-4730-a9fb-df157fbeee12 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.468200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5249cbd-a858-4d19-82f0-fe688a37f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.468957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5249cbd-a858-4d19-82f0-fe688a37f1ae None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.469323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5249cbd-a858-4d19-82f0-fe688a37f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.469602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5249cbd-a858-4d19-82f0-fe688a37f1ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.481137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5249cbd-a858-4d19-82f0-fe688a37f1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-d5249cbd-a858-4d19-82f0-fe688a37f1ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:00.487035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:00.487926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:00.488757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 94/185] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:00.489612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6854d6e-4b3a-4e6a-922d-37141624aa86 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.489612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6854d6e-4b3a-4e6a-922d-37141624aa86 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.490715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6854d6e-4b3a-4e6a-922d-37141624aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.510591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9965-4d15-493e-9559-5c7c4faaccd8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.514183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c6854d6e-4b3a-4e6a-922d-37141624aa86 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:00.515317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c6854d6e-4b3a-4e6a-922d-37141624aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:00.519226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.547547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.548160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.548439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.548708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.549465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=586f72e2a7b642169f7da583ba3508a5, user.id=d47f075f137044fd9b08529f463da346) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:00.549788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:00.551217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:00.558322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 92/186] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/role_assignments?user.id=d47f075f137044fd9b08529f463da346&scope.project.id=586f72e2a7b642169f7da583ba3508a5&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:00.558596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.602908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.614197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 95/187] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:00.616866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6854d6e-4b3a-4e6a-922d-37141624aa86 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.749347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10139aff-86ce-4baa-a6b3-c913ad4ba785 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.794768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.795345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.795753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.796034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] PATH_INFO: `/v3/users/6882ce30dcac4c9191acd491bcb4b231` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.800801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6854d6e-4b3a-4e6a-922d-37141624aa86 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.814407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] RBAC: Authorizing `identity:get_user(user_id=6882ce30dcac4c9191acd491bcb4b231)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:00.816171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:00.818876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 93/188] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/users/6882ce30dcac4c9191acd491bcb4b231 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:00.819848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.839882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:00.840514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:00.840791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:00.841063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:00.842345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:00.843880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:00.846478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 96/189] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:00.847322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:00.862111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.930393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:00.962864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467d34-26dc-4c70-b1bc-4579ff569792 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:00.989295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dce48-b3e9-4d4a-a8a2-c0b52a44e949 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.000704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.001351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.001629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.001905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.002579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:01.002881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.004246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.013117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 94/190] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:01.013928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:01.032114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.032720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.033014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.033289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.108248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.109839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.115413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:01.126043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6432d7-cef7-46a4-b6d0-ed34146dcf28 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.161070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.162351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.162634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.162875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.163722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=52cfabda91074225ac5581142c451796) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:01.164032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.165501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.171694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:01.181369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 95/191] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:01 2022] GET /identity/v3/role_assignments?user.id=52cfabda91074225ac5581142c451796&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:01.182826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:01.220212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 97/192] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:01.221566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:01.324031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef178db6-10c3-46c9-9c40-6808835ddaa8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.342011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29279ca5-7db4-444a-bcdb-8184a9e0dd74 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.369901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.370474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.370755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.371031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.372457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.374486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.376381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 96/193] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:01.377800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:01.389495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.390362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.390814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.391573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] PATH_INFO: `/v3/users/6882ce30dcac4c9191acd491bcb4b231` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.393373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] RBAC: Authorizing `identity:get_user(user_id=6882ce30dcac4c9191acd491bcb4b231)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.395285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.397620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 98/194] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:01 2022] GET /identity/v3/users/6882ce30dcac4c9191acd491bcb4b231 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:01.398519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:01.408799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:01.440511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:01.501320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c2c61-7104-4cdb-a54c-d40a5da14e47 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.525385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d10c3-3b5f-4cc4-945e-8a2423b3ca1f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.537502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.538312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.538736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.539152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.540468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.541971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.543632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 97/195] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:01 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:01.544481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:01.561089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.561721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.561990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.562259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.562903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.564315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.587151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 99/196] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:01 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:01.588068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:01.668404 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:01.683549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1876cf-3cc2-46ec-a0b8-29d1deca31c4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.722470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:01.726139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.727097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.727648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.728131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.746864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9782bfd-8f3d-4167-b0ab-54f76f3a39e8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:01.798210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:01.798984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:01.799595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:01.799876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:01.800909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=6882ce30dcac4c9191acd491bcb4b231) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:01.802013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.802916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.809065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 100/197] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:01 2022] GET /identity/v3/role_assignments?user.id=6882ce30dcac4c9191acd491bcb4b231&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:01.813403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:01.814967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:01.924037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:01.937301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 98/198] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:01.944594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:02.064059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae7182-4aad-4ffc-81cf-91ccf8b5168f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:02.104751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e19f1f-2950-4f0b-a6b8-7edf11224a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:02.105829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19f1f-2950-4f0b-a6b8-7edf11224a5b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:02.106309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19f1f-2950-4f0b-a6b8-7edf11224a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:02.106778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e19f1f-2950-4f0b-a6b8-7edf11224a5b None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:02.108145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e19f1f-2950-4f0b-a6b8-7edf11224a5b None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:02.109859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e19f1f-2950-4f0b-a6b8-7edf11224a5b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:02.112045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 101/199] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:01 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:02.118976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:02.262502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b0160-5492-4c5f-841a-6b34bbde249b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:02.309845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:02.310820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:02.311324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:02.311850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:02.312832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] RBAC: Adding query filter params (role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=6882ce30dcac4c9191acd491bcb4b231) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:02.313364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:02.315008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:02.322382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92a0b-47ed-4cb9-a5c5-2b3cb805c2ac None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:02.322970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92a0b-47ed-4cb9-a5c5-2b3cb805c2ac None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:02.323442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e92a0b-47ed-4cb9-a5c5-2b3cb805c2ac None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:02.325055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 102/200] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:02.330302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bd702-ce46-4c0a-9df5-3f7a37e214a9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:02.330845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bd702-ce46-4c0a-9df5-3f7a37e214a9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:02.331370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bd702-ce46-4c0a-9df5-3f7a37e214a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:02.336763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 99/201] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:02 2022] GET /identity/v3/role_assignments?user.id=6882ce30dcac4c9191acd491bcb4b231&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:02.354398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2b8bd702-ce46-4c0a-9df5-3f7a37e214a9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:02.356084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2b8bd702-ce46-4c0a-9df5-3f7a37e214a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:02.385587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:02.438439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 103/202] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:02.783198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:02.859870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:02.915696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da95b7-870e-42b7-b779-bbb2fb2b1608 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:02.963541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:02.964195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:02.964474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:02.964743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:02.983243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:02.988590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:02.990035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:02.990847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 100/203] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:02.996188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bd702-ce46-4c0a-9df5-3f7a37e214a9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:03.219184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bd702-ce46-4c0a-9df5-3f7a37e214a9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:03.285954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:03.287099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:03.287374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:03.287646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:03.288316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:03.288615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:03.290020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:03.305014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 104/204] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:03.310892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:03.435595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dde4f-cf24-41fe-b11d-71f138ff922b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:03.452272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:03.480689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:03.481253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:03.481532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:03.481804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] PATH_INFO: `/v3/users/1c70cc157d9e42589b3d12e1e9b61268` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:03.482959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] RBAC: Authorizing `identity:get_user(user_id=1c70cc157d9e42589b3d12e1e9b61268)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:03.484413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:03.486185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 101/205] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:03 2022] GET /identity/v3/users/1c70cc157d9e42589b3d12e1e9b61268 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:03.492118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:03.506062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:03.616882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9de49-e73a-4089-8bbf-3771f7979295 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:03.659467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:03.660079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:03.660352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:03.660618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:03.758185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:03.759550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:03.778522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:03.905463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 105/206] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:03.911332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:04.038672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8a714-6853-4adc-8dad-48f7322f2a33 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:04.073966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe6085-7bfe-43fc-9235-ff1efcefe218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:04.074598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe6085-7bfe-43fc-9235-ff1efcefe218 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.074876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe6085-7bfe-43fc-9235-ff1efcefe218 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.075149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe6085-7bfe-43fc-9235-ff1efcefe218 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.076289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe6085-7bfe-43fc-9235-ff1efcefe218 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:04.077846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe6085-7bfe-43fc-9235-ff1efcefe218 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:04.079533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 102/207] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:03 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:04.085604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:04.237919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cb5b1-6d2d-462d-8ab0-925beca8c480 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:04.255810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:04.295020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371285-9859-4348-9f6d-bae8e4c8dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:04.295569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371285-9859-4348-9f6d-bae8e4c8dd3a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.295850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371285-9859-4348-9f6d-bae8e4c8dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.296118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371285-9859-4348-9f6d-bae8e4c8dd3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.296857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371285-9859-4348-9f6d-bae8e4c8dd3a None admin] RBAC: Adding query filter params (role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90, scope.project.id=ac517b9e9caf41319a6fd497a84e8420, user.id=1c70cc157d9e42589b3d12e1e9b61268) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:04.297179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371285-9859-4348-9f6d-bae8e4c8dd3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:04.298612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371285-9859-4348-9f6d-bae8e4c8dd3a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:04.310042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 106/208] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:04 2022] GET /identity/v3/role_assignments?user.id=1c70cc157d9e42589b3d12e1e9b61268&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:04.388512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cf6af-5f32-4e9f-92e4-9c27429ae3b5 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.388947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cf6af-5f32-4e9f-92e4-9c27429ae3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.389250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cf6af-5f32-4e9f-92e4-9c27429ae3b5 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.390920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 103/209] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:04.396974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9261d-9502-4d0d-8199-e9a13b69605a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.397283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9261d-9502-4d0d-8199-e9a13b69605a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.397562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9261d-9502-4d0d-8199-e9a13b69605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.426357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-70d9261d-9502-4d0d-8199-e9a13b69605a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:04.427693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-70d9261d-9502-4d0d-8199-e9a13b69605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:04.520601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 107/210] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:04.593584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bd4ae-87c9-4e9a-8ee2-75ad1c0b85da None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.593918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bd4ae-87c9-4e9a-8ee2-75ad1c0b85da None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.594217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bd4ae-87c9-4e9a-8ee2-75ad1c0b85da None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.595884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 104/211] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:04.601876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f3c6f-12aa-4bd0-a0ae-d85d9fad32db None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.602153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f3c6f-12aa-4bd0-a0ae-d85d9fad32db None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.602412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f3c6f-12aa-4bd0-a0ae-d85d9fad32db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.628338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5d9f3c6f-12aa-4bd0-a0ae-d85d9fad32db None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:04.629562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5d9f3c6f-12aa-4bd0-a0ae-d85d9fad32db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:04.703749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 108/212] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:04.863632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ab66-6925-445b-9be1-76ee1a1b6d9b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.864317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ab66-6925-445b-9be1-76ee1a1b6d9b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.864797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ab66-6925-445b-9be1-76ee1a1b6d9b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.866848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f3c6f-12aa-4bd0-a0ae-d85d9fad32db None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:04.866980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 105/213] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:04.872173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bada10-b8ee-45a1-9793-cf6c7a271a12 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:04.872456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bada10-b8ee-45a1-9793-cf6c7a271a12 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:04.872734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bada10-b8ee-45a1-9793-cf6c7a271a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:04.898908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f6bada10-b8ee-45a1-9793-cf6c7a271a12 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:04.900226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f6bada10-b8ee-45a1-9793-cf6c7a271a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:04.906887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:04.965218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:04.992565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 106/214] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:04.997555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f3c6f-12aa-4bd0-a0ae-d85d9fad32db None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.007745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bada10-b8ee-45a1-9793-cf6c7a271a12 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.038516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.039604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.040100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.040589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.042066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:05.043864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:05.046158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 109/215] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:05.052018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.136826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bada10-b8ee-45a1-9793-cf6c7a271a12 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.169970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88fafb-c9f9-4f64-b2f4-3bf8b94eb3d5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.172159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:05.184109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.184852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.185231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.185574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.196817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:05.201831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:05.202754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:05.203553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 107/216] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:05.210676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.220509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c012557-b5c5-426d-8ce8-f5094bbc5f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.221127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012557-b5c5-426d-8ce8-f5094bbc5f4e None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.221450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012557-b5c5-426d-8ce8-f5094bbc5f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.222101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012557-b5c5-426d-8ce8-f5094bbc5f4e None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.222764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c012557-b5c5-426d-8ce8-f5094bbc5f4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:05.224832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c012557-b5c5-426d-8ce8-f5094bbc5f4e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:05.247093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 110/217] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:05 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:42:05.248572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c476e-808e-476c-af8a-c41d239d2ba7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.248880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c476e-808e-476c-af8a-c41d239d2ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.249121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c476e-808e-476c-af8a-c41d239d2ba7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.250525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 111/218] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:05.256997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b498f-77c4-4a0d-835b-cb85e7fecf12 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.257386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b498f-77c4-4a0d-835b-cb85e7fecf12 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.257590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b498f-77c4-4a0d-835b-cb85e7fecf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.267363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:05.279151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f59b498f-77c4-4a0d-835b-cb85e7fecf12 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:05.280800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f59b498f-77c4-4a0d-835b-cb85e7fecf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:05.334389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacf1e-dce7-4696-88c0-fb2d44a55f19 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.359339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 112/219] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:05.360270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b498f-77c4-4a0d-835b-cb85e7fecf12 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.385221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.386158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.386613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.387114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.388165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:05.388639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:05.390370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:05.400682 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 108/220] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:05.406559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.477601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:05.501907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b498f-77c4-4a0d-835b-cb85e7fecf12 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.535118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef34d15-e2f3-476e-b574-eef15ba36409 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.537587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:05.543678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.544378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.544651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.544911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.558787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:05.564393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:05.565650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:05.566432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:05.569772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 113/221] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:05.575297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.582525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.583386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.583960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.584330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] PATH_INFO: `/v3/users/6882ce30dcac4c9191acd491bcb4b231` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.585707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] RBAC: Authorizing `identity:get_user(user_id=6882ce30dcac4c9191acd491bcb4b231)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:05.587237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:05.596594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 109/222] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/users/6882ce30dcac4c9191acd491bcb4b231 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:05.597817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.723279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106be7-51c3-4df8-b4d7-e46ba66882c0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.730439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0496-e945-4c17-996a-f22cc6502535 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.760731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.761377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.761658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.761934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.762609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:05.762913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:05.764286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:05.774504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 114/223] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:05.775468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.776878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.777552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.777882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.778151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.780619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:05.782100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:05.784133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 110/224] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:05.785495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.793362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:05.852458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:05.903506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bea5bd-555b-4489-a6a0-065372efb0a1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.930397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cf440-b266-456a-b2a0-a13b4af44cf2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:05.949229 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.950072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.950377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.950770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.962774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:05.969760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:05.970870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:05.971849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:05.974353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 115/225] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:05.975128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:05.975689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:05.976682 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:05.977228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:05.977667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] PATH_INFO: `/v3/users/7a6bf6cd798b479989b0a02bc01f4925` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:05.998294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6bf6cd798b479989b0a02bc01f4925)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:06.000513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:06.002663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 111/226] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:05 2022] GET /identity/v3/users/7a6bf6cd798b479989b0a02bc01f4925 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:06.003877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:06.059510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:06.104849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bd230-d511-4571-8f6d-1b41085dac4e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:06.114148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:06.121806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef795f-bf70-4c60-a6cb-0e294b627958 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:06.154736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:06.155599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:06.155998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:06.156373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/6882ce30dcac4c9191acd491bcb4b231/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:06.159246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] RBAC: Authorizing `identity:create_grant(project_id=921a065cbcb549c8ab5a2a774192ebc5, user_id=6882ce30dcac4c9191acd491bcb4b231, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:06.160683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:06.161841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:06.162673 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:06.163412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:06.164354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:06.165474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:06.166020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:06.167434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:06.175537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 116/227] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:05 2022] PUT /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/6882ce30dcac4c9191acd491bcb4b231/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:06.177708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:06.181408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 112/228] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:06.193180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:06.317186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee1ba6-eae4-46ad-81fe-2ec794897bfc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:06.357392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df663a7-1128-48d0-bd0c-7cdd048283ab None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:06.380529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:06.392226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:06.392850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:06.393127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:06.393433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:06.415309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:06.416431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:06.416909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:06.417454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] PATH_INFO: `/v3/users/6882ce30dcac4c9191acd491bcb4b231` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:06.418928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] RBAC: Authorizing `identity:get_user(user_id=6882ce30dcac4c9191acd491bcb4b231)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:06.421324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:06.424128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 113/229] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:06 2022] GET /identity/v3/users/6882ce30dcac4c9191acd491bcb4b231 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:06.429685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:06.467260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:06.483958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:06.485783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:06.606667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 117/230] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:06.617176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:06.652297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:06.703330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea8f8-49c1-46dc-9b00-a9ed788910ff None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:06.777624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:06.778383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:06.778666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:06.778984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:06.783065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:06.792068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:06.799483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 114/231] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:06 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:06.805389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44e03-80fe-432d-ba4d-3d557f3e2933 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:06.807611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:06.890789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:06.891435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:06.891714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:06.891987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:06.898557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:06.900073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:06.902097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 118/232] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:06 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:06.907640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:07.011279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:07.025120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926c2a3-71ad-4c52-970d-b1e4663880da None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:07.088761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d974776-8132-440b-ae18-5e9832c84f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:07.090126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974776-8132-440b-ae18-5e9832c84f39 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:07.090615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974776-8132-440b-ae18-5e9832c84f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:07.090899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974776-8132-440b-ae18-5e9832c84f39 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/6882ce30dcac4c9191acd491bcb4b231/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:07.099128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d974776-8132-440b-ae18-5e9832c84f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=921a065cbcb549c8ab5a2a774192ebc5, user_id=6882ce30dcac4c9191acd491bcb4b231, role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:07.100620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d974776-8132-440b-ae18-5e9832c84f39 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:07.102000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:07.112595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767890a1-3182-4a58-b287-bb3e412a5be2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:07.139311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 115/233] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:06 2022] PUT /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/6882ce30dcac4c9191acd491bcb4b231/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:07.190226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf9695-c022-4bee-9075-ebf3174eefc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:07.190871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9695-c022-4bee-9075-ebf3174eefc6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:07.191154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9695-c022-4bee-9075-ebf3174eefc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:07.191428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9695-c022-4bee-9075-ebf3174eefc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:07.192174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf9695-c022-4bee-9075-ebf3174eefc6 None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=7a6bf6cd798b479989b0a02bc01f4925) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:07.193067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf9695-c022-4bee-9075-ebf3174eefc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:07.206569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf9695-c022-4bee-9075-ebf3174eefc6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:07.235149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 119/234] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:06 2022] GET /identity/v3/role_assignments?user.id=7a6bf6cd798b479989b0a02bc01f4925&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:07.875999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcb69f-f959-4ae0-91dd-b79a1aa45137 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:07.876280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcb69f-f959-4ae0-91dd-b79a1aa45137 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:07.876565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcb69f-f959-4ae0-91dd-b79a1aa45137 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:07.878239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 116/235] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:07.883879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615287e-d6d2-4376-9c09-128e0f523eb6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:07.884163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615287e-d6d2-4376-9c09-128e0f523eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:07.884439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615287e-d6d2-4376-9c09-128e0f523eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:07.910989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f615287e-d6d2-4376-9c09-128e0f523eb6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:07.912893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f615287e-d6d2-4376-9c09-128e0f523eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:07.989830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 120/236] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:08.178297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86488-c329-4d6a-a2b6-76a36f8a17ec None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:08.178805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86488-c329-4d6a-a2b6-76a36f8a17ec None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:08.178805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86488-c329-4d6a-a2b6-76a36f8a17ec None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:08.180336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 117/237] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:08.186188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac5c74-4862-42fe-ae55-9ec36ea69fa4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:08.186722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac5c74-4862-42fe-ae55-9ec36ea69fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:08.187202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac5c74-4862-42fe-ae55-9ec36ea69fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:08.205937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-08ac5c74-4862-42fe-ae55-9ec36ea69fa4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:08.207833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-08ac5c74-4862-42fe-ae55-9ec36ea69fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:08.300666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:08.567960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86488-c329-4d6a-a2b6-76a36f8a17ec None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:08.730847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86488-c329-4d6a-a2b6-76a36f8a17ec None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:08.735598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac5c74-4862-42fe-ae55-9ec36ea69fa4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:08.774561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:08.796377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd381b23-f61d-4c2f-bcee-d0d2a34eb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:08.797025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381b23-f61d-4c2f-bcee-d0d2a34eb368 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:08.797331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381b23-f61d-4c2f-bcee-d0d2a34eb368 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:08.797604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381b23-f61d-4c2f-bcee-d0d2a34eb368 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:08.820556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd381b23-f61d-4c2f-bcee-d0d2a34eb368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-fd381b23-f61d-4c2f-bcee-d0d2a34eb368 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:08.836501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:08.837463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:08.838248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 118/239] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:08.839396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dba0f0-f60f-4b70-bfb9-fb54d408e40b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:08.839487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dba0f0-f60f-4b70-bfb9-fb54d408e40b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:08.839765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dba0f0-f60f-4b70-bfb9-fb54d408e40b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:08.841533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 119/240] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:08.845987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dba0f0-f60f-4b70-bfb9-fb54d408e40b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:08.869956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac5c74-4862-42fe-ae55-9ec36ea69fa4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:08.872170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:08.911717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74fc7-0dc6-4910-af22-792ff70bf7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:08.912823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74fc7-0dc6-4910-af22-792ff70bf7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:08.913349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74fc7-0dc6-4910-af22-792ff70bf7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:08.914098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74fc7-0dc6-4910-af22-792ff70bf7e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:08.915624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a74fc7-0dc6-4910-af22-792ff70bf7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:08.917353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a74fc7-0dc6-4910-af22-792ff70bf7e5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:08.919052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 122/241] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:08.919966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fee01-7d80-4505-825a-38f6407753f0 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:08.920242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fee01-7d80-4505-825a-38f6407753f0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:08.920509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fee01-7d80-4505-825a-38f6407753f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:08.945357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f03fee01-7d80-4505-825a-38f6407753f0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:08.946843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f03fee01-7d80-4505-825a-38f6407753f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:08.970331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dba0f0-f60f-4b70-bfb9-fb54d408e40b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:09.018186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:09.019664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.020120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.021483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.022358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:09.022833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:09.024377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:09.025014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 123/242] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:09.026005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fee01-7d80-4505-825a-38f6407753f0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.038981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 120/243] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:09.044770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.050351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:09.132345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:09.135097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fee01-7d80-4505-825a-38f6407753f0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:09.159539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cdd7d-4195-44b2-bc7b-fc4ecb38274e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:09.179646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:09.180359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.180671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.180940 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.181612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:09.183038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:09.201479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:09.202802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.203389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.203856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] PATH_INFO: `/v3/users/4f02e2cf1b524b159352626156c89bf8` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.221080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 124/244] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:09 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:09.224127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] RBAC: Authorizing `identity:get_user(user_id=4f02e2cf1b524b159352626156c89bf8)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:09.225998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:09.228009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 121/245] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:09 2022] GET /identity/v3/users/4f02e2cf1b524b159352626156c89bf8 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:09.234006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.347763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:09.376814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa1be0-0e6e-4cfc-a8d4-bcbd0aa1b43f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:09.425732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:09.426279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.426557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.426861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.475341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.518497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:09.519917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:09.597396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e79be-c2e4-4a72-b8f6-f78a9d9cb74e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:09.614844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:09.644687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:09.645003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 125/246] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:09.646552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.647029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.647515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.652234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.661100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:09.673682 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:09.679472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:09.680416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:09.681279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:09.683974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 122/247] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:09.691158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.789327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008ee5-e62b-49df-a443-c8362cee2104 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:09.820527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d166ec-b3a6-48d4-b242-e1f4322b3c4c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:09.830509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df23bb-fc67-4cf8-9d53-f4ed8dd4302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:09.831144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df23bb-fc67-4cf8-9d53-f4ed8dd4302d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.831417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df23bb-fc67-4cf8-9d53-f4ed8dd4302d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.831685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df23bb-fc67-4cf8-9d53-f4ed8dd4302d None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.833952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df23bb-fc67-4cf8-9d53-f4ed8dd4302d None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:09.835541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df23bb-fc67-4cf8-9d53-f4ed8dd4302d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:09.837269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 126/248] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:09 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:09.838445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a359f9-ec71-4081-bf8b-a8a7d5f86ea8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.838727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a359f9-ec71-4081-bf8b-a8a7d5f86ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.839174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a359f9-ec71-4081-bf8b-a8a7d5f86ea8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.841861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 127/249] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:09.846688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3016545-eccc-45d4-8d8b-9091b0e2909e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.847212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3016545-eccc-45d4-8d8b-9091b0e2909e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.847675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3016545-eccc-45d4-8d8b-9091b0e2909e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.870539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a3016545-eccc-45d4-8d8b-9091b0e2909e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:09.870724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:09.871312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:09.871586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:09.871752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a3016545-eccc-45d4-8d8b-9091b0e2909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:09.871843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:09.872511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:09.872818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:09.874220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:09.884867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 123/250] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:09.886763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.927209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:09.961276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 128/251] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:09.961553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3016545-eccc-45d4-8d8b-9091b0e2909e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:09.970581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:10.053263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25448591-69e9-439f-b0c7-1c9beede7cde None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:10.107856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:10.108479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:10.108760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:10.109072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:10.109846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] RBAC: Adding query filter params (role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=4f02e2cf1b524b159352626156c89bf8) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:10.110153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:10.111613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:10.122881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 124/252] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:09 2022] GET /identity/v3/role_assignments?user.id=4f02e2cf1b524b159352626156c89bf8&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:10.162026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3016545-eccc-45d4-8d8b-9091b0e2909e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:10.218945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f61dc-6810-4405-a244-5bbbc6573c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:10.219505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f61dc-6810-4405-a244-5bbbc6573c7a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:10.219779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f61dc-6810-4405-a244-5bbbc6573c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:10.220046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f61dc-6810-4405-a244-5bbbc6573c7a None admin] PATH_INFO: `/v3/users/6882ce30dcac4c9191acd491bcb4b231` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:10.221199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f61dc-6810-4405-a244-5bbbc6573c7a None admin] RBAC: Authorizing `identity:get_user(user_id=6882ce30dcac4c9191acd491bcb4b231)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:10.222631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f61dc-6810-4405-a244-5bbbc6573c7a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:10.226051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 129/253] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:09 2022] GET /identity/v3/users/6882ce30dcac4c9191acd491bcb4b231 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:10.230757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:10.257181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00660a-f516-4032-86f4-07c50114e3f2 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:10.257482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00660a-f516-4032-86f4-07c50114e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:10.257737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00660a-f516-4032-86f4-07c50114e3f2 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:10.259354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 130/254] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:10.264836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e851-9b7e-42b7-a56d-4fab5366dd7c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:10.265104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e851-9b7e-42b7-a56d-4fab5366dd7c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:10.265411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e851-9b7e-42b7-a56d-4fab5366dd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:10.300842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-db89e851-9b7e-42b7-a56d-4fab5366dd7c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:10.304766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db89e851-9b7e-42b7-a56d-4fab5366dd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:10.358373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:10.389664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 131/255] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:10.390559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e851-9b7e-42b7-a56d-4fab5366dd7c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:10.439369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff3f4d-4b53-453d-b7d9-6dabbfcfbb85 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:10.482300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:10.510050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:10.510668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:10.510943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:10.511220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:10.598093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e851-9b7e-42b7-a56d-4fab5366dd7c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:10.637586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:10.639058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:10.678208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:10.678853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:10.679124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:10.679391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:10.700587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:10.705473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:10.706342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:10.707104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 132/256] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:10.715065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:10.779917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:10.850467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 125/257] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:10.851973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:10.884098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540bf5d-82af-4359-a4d8-4ac3eaefd0a3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:10.899215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:10.920980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:10.921615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:10.921888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:10.922154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:10.922819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:10.923113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:10.924478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:10.933383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 133/258] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:10.934395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.043347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc9697-45d9-4fec-88eb-d1e82b9eac25 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.046523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:11.079628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.080267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.080542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.080808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.082100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:11.084420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:11.086308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 134/259] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:10 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:11.090020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.135030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e8d23-b983-4ee2-adc2-609b0efe9a31 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.198537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698cc7-40cb-4ddf-812a-bda88968d326 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.234160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.234770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.235048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.235320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] PATH_INFO: `/v3/users/7a6bf6cd798b479989b0a02bc01f4925` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.236436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6bf6cd798b479989b0a02bc01f4925)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:11.238033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:11.239841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 135/260] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:11 2022] GET /identity/v3/users/7a6bf6cd798b479989b0a02bc01f4925 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:11.241340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.249882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.250609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.250887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.251159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.274055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:11.278408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:11.283297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:11.284234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:11.285032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:11.290657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 126/261] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:11.291647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.347967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8c1d-48f6-4f98-9989-3e78bfdf7912 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.384450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.385061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.393464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.393872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.394675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=6882ce30dcac4c9191acd491bcb4b231) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:11.395092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:11.396976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:11.403657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 136/262] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:11 2022] GET /identity/v3/role_assignments?user.id=6882ce30dcac4c9191acd491bcb4b231&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:11.416161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.422109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:11.443518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6b76b-3abd-4d26-b24e-bb0d1b71dffc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.501882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.502544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.502824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.503094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.504256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:11.512642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:11.512642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 127/263] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:11 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:11.514066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.629034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:11.647503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32b2dc-5b3c-4928-80b3-756870a06769 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.701282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.701887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.702161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.702427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.703193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:11.703593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:11.704960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:11.717135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 137/264] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:11.720453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cc5f2-0715-460b-a9a2-576edf0ccead None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.722863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.762943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.763610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.763889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.764165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/7a6bf6cd798b479989b0a02bc01f4925/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.767077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] RBAC: Authorizing `identity:create_grant(project_id=921a065cbcb549c8ab5a2a774192ebc5, user_id=7a6bf6cd798b479989b0a02bc01f4925, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:11.769238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:11.791723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 128/265] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:11 2022] PUT /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/7a6bf6cd798b479989b0a02bc01f4925/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:11.869314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074e72-9cc0-489c-929f-19434579036e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:11.910577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:11.911698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:11.912176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:11.912582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] PATH_INFO: `/v3/users/6882ce30dcac4c9191acd491bcb4b231` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:11.913770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] RBAC: Authorizing `identity:get_user(user_id=6882ce30dcac4c9191acd491bcb4b231)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:11.915188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:11.917174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 138/266] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:11 2022] GET /identity/v3/users/6882ce30dcac4c9191acd491bcb4b231 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:11.922391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:11.944418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:12.075540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57373-f9e0-4600-9a17-1f0a6c2c8369 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:12.117473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:12.118097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:12.118376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:12.118647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:12.191026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:12.192988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:12.204279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:12.325919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 129/267] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:12.331021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:12.365371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:12.464016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6d32f-7bc0-4647-8c31-3e611cd347b3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:12.500357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a4166-7095-46c5-89f8-f6e68958526c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:12.501459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4166-7095-46c5-89f8-f6e68958526c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:12.501934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4166-7095-46c5-89f8-f6e68958526c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:12.502409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a4166-7095-46c5-89f8-f6e68958526c None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:12.503744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a4166-7095-46c5-89f8-f6e68958526c None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:12.505445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a4166-7095-46c5-89f8-f6e68958526c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:12.507362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 139/268] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:12 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:12.517197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:12.569471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332de64-5815-4c3e-a3ed-87806da60634 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:12.569772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332de64-5815-4c3e-a3ed-87806da60634 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:12.570020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332de64-5815-4c3e-a3ed-87806da60634 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:12.571489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 140/269] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:12.577049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7056-1be1-43f1-9124-ea7fc71a0bd7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:12.577369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7056-1be1-43f1-9124-ea7fc71a0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:12.577645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7056-1be1-43f1-9124-ea7fc71a0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:12.612618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5eab7056-1be1-43f1-9124-ea7fc71a0bd7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:12.613906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5eab7056-1be1-43f1-9124-ea7fc71a0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:12.682127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47ac02-4ca0-4160-ba5c-a2b389d4c610 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:12.691957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:12.711238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 141/270] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:12.713061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735178b-a676-46a2-bb2d-3e6775d4f1c9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:12.713536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735178b-a676-46a2-bb2d-3e6775d4f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:12.713950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735178b-a676-46a2-bb2d-3e6775d4f1c9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:12.720040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 142/271] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:12.720508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:12.721260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:12.721636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:12.721855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc350-0f56-4a4c-b1e9-e466e02706d8 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:12.722091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:12.722412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc350-0f56-4a4c-b1e9-e466e02706d8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:12.722816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebc350-0f56-4a4c-b1e9-e466e02706d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:12.723115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] RBAC: Adding query filter params (role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=6882ce30dcac4c9191acd491bcb4b231) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:12.724135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:12.725890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:12.739838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 130/272] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:12 2022] GET /identity/v3/role_assignments?user.id=6882ce30dcac4c9191acd491bcb4b231&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:12.744150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9bebc350-0f56-4a4c-b1e9-e466e02706d8 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:12.745611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9bebc350-0f56-4a4c-b1e9-e466e02706d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:12.774773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:12.821631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 143/273] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:13.068700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:13.116283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebc350-0f56-4a4c-b1e9-e466e02706d8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:13.194558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a20fd-b50d-442a-84d6-4f51b5d47286 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:13.252346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:13.253608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.254475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.255734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.257612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:13.259946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:13.260696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebc350-0f56-4a4c-b1e9-e466e02706d8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:13.262499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 131/274] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:13.274339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:13.306515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1befa4c-4c5b-43ba-8c19-3a6c9c82c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:13.307211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1befa4c-4c5b-43ba-8c19-3a6c9c82c4ba None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.307490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1befa4c-4c5b-43ba-8c19-3a6c9c82c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.307813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1befa4c-4c5b-43ba-8c19-3a6c9c82c4ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.321074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1befa4c-4c5b-43ba-8c19-3a6c9c82c4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b1befa4c-4c5b-43ba-8c19-3a6c9c82c4ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:13.326678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:13.327524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:13.328299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 144/275] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:13.333187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb45c-f298-44eb-af1f-1edb0dd584f7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.333187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb45c-f298-44eb-af1f-1edb0dd584f7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.333187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb45c-f298-44eb-af1f-1edb0dd584f7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.333187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 145/276] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:13.335862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cb45c-f298-44eb-af1f-1edb0dd584f7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:13.340269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:13.355180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:13.405762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1064a-e632-4472-9abf-0851aff8c833 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:13.441691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570edd0e-2fab-41ed-9f01-e0c66d8f357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:13.442319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570edd0e-2fab-41ed-9f01-e0c66d8f357e None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.442593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570edd0e-2fab-41ed-9f01-e0c66d8f357e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.442859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570edd0e-2fab-41ed-9f01-e0c66d8f357e None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.443915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570edd0e-2fab-41ed-9f01-e0c66d8f357e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:13.445409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570edd0e-2fab-41ed-9f01-e0c66d8f357e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:13.456966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cb45c-f298-44eb-af1f-1edb0dd584f7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:13.477184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 132/277] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:13 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:13.477184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f685-19fe-4204-91fd-740d136b9d59 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.477184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f685-19fe-4204-91fd-740d136b9d59 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.477184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f685-19fe-4204-91fd-740d136b9d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.492559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-74c6f685-19fe-4204-91fd-740d136b9d59 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:13.493930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-74c6f685-19fe-4204-91fd-740d136b9d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:13.513528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:13.514294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.514670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.514986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.515668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:13.515969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:13.517495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:13.528163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 146/278] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:13.534725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:13.577578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 133/279] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:13.624121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:13.659448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c7a29-cb16-4aef-a3ea-166dd68946ea None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:13.696362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:13.696995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.697306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.697579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] PATH_INFO: `/v3/users/f28a2b5b94ab4aeea97f774f473dd38b` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.713329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a2b5b94ab4aeea97f774f473dd38b)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:13.714773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:13.716556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 147/280] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:13 2022] GET /identity/v3/users/f28a2b5b94ab4aeea97f774f473dd38b => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:13.722192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f685-19fe-4204-91fd-740d136b9d59 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:13.755350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:13.834867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f685-19fe-4204-91fd-740d136b9d59 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:13.876097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:13.876712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:13.876985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:13.877274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:13.878011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, user.id=f28a2b5b94ab4aeea97f774f473dd38b, scope.system=all) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:13.878315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:13.880287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:13.881993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:13.886169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 134/281] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Sep 19 11:42:13 2022] GET /identity/v3/role_assignments?user.id=f28a2b5b94ab4aeea97f774f473dd38b&scope.system=all&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:14.012466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2b00-fd2a-4abd-a839-a874800454b1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:14.047025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:14.054244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:14.054896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:14.055168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:14.055431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:14.067846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:14.073208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:14.074070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:14.074874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 148/282] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:14.080883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:14.184945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:14.198127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe355e-766b-45be-ab82-a46e6ab02d58 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:14.233348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:14.233947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:14.234220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:14.234487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:14.235212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:14.235514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:14.236878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:14.246464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 135/283] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:14.251884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:14.360018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4467e6-3a86-4e5f-ae29-95aeb178bd86 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:14.403533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ff012-eb9a-41a7-8273-00be0321a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:14.404164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ff012-eb9a-41a7-8273-00be0321a193 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:14.404434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ff012-eb9a-41a7-8273-00be0321a193 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:14.404697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ff012-eb9a-41a7-8273-00be0321a193 None admin] PATH_INFO: `/v3/users/4f02e2cf1b524b159352626156c89bf8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:14.405842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ff012-eb9a-41a7-8273-00be0321a193 None admin] RBAC: Authorizing `identity:get_user(user_id=4f02e2cf1b524b159352626156c89bf8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:14.407337 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ff012-eb9a-41a7-8273-00be0321a193 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:14.409073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 149/284] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:14 2022] GET /identity/v3/users/4f02e2cf1b524b159352626156c89bf8 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:14.415546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:14.491157 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157103-9059-4ed4-8ace-c8562e35871c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:14.491350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157103-9059-4ed4-8ace-c8562e35871c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:14.491605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157103-9059-4ed4-8ace-c8562e35871c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:14.492936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 150/285] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:14.498318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c9f9-0d3e-4301-bd85-11c97471100e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:14.498587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c9f9-0d3e-4301-bd85-11c97471100e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:14.498854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c9f9-0d3e-4301-bd85-11c97471100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:14.517420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9362c9f9-0d3e-4301-bd85-11c97471100e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:14.518664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9362c9f9-0d3e-4301-bd85-11c97471100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:14.570091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92567-abfa-4848-b79a-8f98f76f7060 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:14.583797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:14.591577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 151/286] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:14.654606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:14.654606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:14.654606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:14.654606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:14.657879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:14.659421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:14.661363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 136/287] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:14 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:14.668738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c9f9-0d3e-4301-bd85-11c97471100e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:14.807147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c9f9-0d3e-4301-bd85-11c97471100e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:14.843692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:14.844350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:14.844621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:14.844891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/4f02e2cf1b524b159352626156c89bf8/roles/7b9ede94d1c14a66b4ebd4cc6ca2ea90` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:14.846865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] RBAC: Authorizing `identity:create_grant(project_id=921a065cbcb549c8ab5a2a774192ebc5, user_id=4f02e2cf1b524b159352626156c89bf8, role_id=7b9ede94d1c14a66b4ebd4cc6ca2ea90)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:14.849119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:14.863703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 152/288] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:14 2022] PUT /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/users/4f02e2cf1b524b159352626156c89bf8/roles/7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:15.034063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:15.062879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:15.159044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b45b7c-236c-476c-b879-ead0dd015c1f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:15.203320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:15.203952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:15.204230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:15.204503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:15.220183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:15.225871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:15.226729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:15.227523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 137/289] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:15.233003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:15.286842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:15.343243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82fd8-ba28-493e-8fa0-4391288c736f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:15.380449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:15.381192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:15.381371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:15.381597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:15.382260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:15.382556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:15.383904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:15.392688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 153/290] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:15.399334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:15.502078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:15.529405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e374d1-6b2f-4dd6-b475-d196e56b54cf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:15.564360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:15.564991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:15.565306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:15.565580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] PATH_INFO: `/v3/users/7a6bf6cd798b479989b0a02bc01f4925` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:15.566731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6bf6cd798b479989b0a02bc01f4925)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:15.568861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:15.570483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 138/291] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:15 2022] GET /identity/v3/users/7a6bf6cd798b479989b0a02bc01f4925 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:15.576172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:15.690756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c657e-275b-49e2-bd3f-f1026f3ec729 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:15.710618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:15.740553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:15.741168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:15.741451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:15.741727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:15.816067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:15.817668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:15.925664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 154/292] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:15.931961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:16.087364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0398047-c0a4-4e8a-bdfb-0d5c64b13e72 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:16.134638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859a16b-85b6-4444-a05b-2d5d7cb8bf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:16.135275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a16b-85b6-4444-a05b-2d5d7cb8bf53 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.135551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a16b-85b6-4444-a05b-2d5d7cb8bf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.135822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859a16b-85b6-4444-a05b-2d5d7cb8bf53 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.137884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859a16b-85b6-4444-a05b-2d5d7cb8bf53 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:16.139332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859a16b-85b6-4444-a05b-2d5d7cb8bf53 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:16.141129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 139/293] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:15 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:16.147042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:16.171799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:16.286610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6f327-4f48-4275-a392-639a4e43ce0e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:16.322440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fdf43-6c6d-4f38-8cbe-e1f259c195f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:16.323049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fdf43-6c6d-4f38-8cbe-e1f259c195f9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.323328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fdf43-6c6d-4f38-8cbe-e1f259c195f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.323646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fdf43-6c6d-4f38-8cbe-e1f259c195f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.324379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fdf43-6c6d-4f38-8cbe-e1f259c195f9 None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=7a6bf6cd798b479989b0a02bc01f4925) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:16.324687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fdf43-6c6d-4f38-8cbe-e1f259c195f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:16.326146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fdf43-6c6d-4f38-8cbe-e1f259c195f9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:16.336502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 155/294] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:16 2022] GET /identity/v3/role_assignments?user.id=7a6bf6cd798b479989b0a02bc01f4925&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:16.560102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd096d-f473-4ddc-9ba1-3ec69db6a7cc None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.560662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd096d-f473-4ddc-9ba1-3ec69db6a7cc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.560662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd096d-f473-4ddc-9ba1-3ec69db6a7cc None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.562440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 140/295] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:16.569012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caa753-19c3-4c2a-814e-2484acc6a27f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.569574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caa753-19c3-4c2a-814e-2484acc6a27f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.569574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caa753-19c3-4c2a-814e-2484acc6a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.596310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-07caa753-19c3-4c2a-814e-2484acc6a27f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:16.597622 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-07caa753-19c3-4c2a-814e-2484acc6a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:16.689515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7824-4ba3-438c-9719-40e365585e00 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.689797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7824-4ba3-438c-9719-40e365585e00 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.690066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7824-4ba3-438c-9719-40e365585e00 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.691566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 141/296] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:16.699376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb6257-aa3a-4558-aa11-e2c3fe901f62 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.699659 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb6257-aa3a-4558-aa11-e2c3fe901f62 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.699934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb6257-aa3a-4558-aa11-e2c3fe901f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.712626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 156/297] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:16.724123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5feb6257-aa3a-4558-aa11-e2c3fe901f62 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:16.725354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5feb6257-aa3a-4558-aa11-e2c3fe901f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:16.746614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:16.802676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 142/298] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:16.862343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2575-08b4-47b8-8307-d46f3e1f167e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.862701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2575-08b4-47b8-8307-d46f3e1f167e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.863070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2575-08b4-47b8-8307-d46f3e1f167e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.865664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 157/299] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:16.871406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fc1be-67e0-4533-93f1-352ecd71f69f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:16.871693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fc1be-67e0-4533-93f1-352ecd71f69f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:16.871966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fc1be-67e0-4533-93f1-352ecd71f69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:16.895257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c92fc1be-67e0-4533-93f1-352ecd71f69f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:16.898253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c92fc1be-67e0-4533-93f1-352ecd71f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:16.974742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 143/300] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:17.028278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2575-08b4-47b8-8307-d46f3e1f167e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.038316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.116654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fc1be-67e0-4533-93f1-352ecd71f69f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.141954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2575-08b4-47b8-8307-d46f3e1f167e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.181802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.182427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.182701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.182970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.194440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:17.199500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:17.200360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:17.201126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 158/301] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:17.202542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.209424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.231768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fc1be-67e0-4533-93f1-352ecd71f69f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.267546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.268176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.268448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.268713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.281100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:17.283489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:17.287196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:17.288379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:17.289210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 144/302] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:17.289851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.324152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2c67f-3a76-4fd1-b3c3-493b1b4ba8a6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.362231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.363040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.363312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.363579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.364399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:17.364699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.366107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:17.375439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 159/303] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:17.376133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.397435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1d000-ff1c-4aec-937e-d1dbc52e07e6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.436117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.436741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.437016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.437307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.438399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.439823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:17.445494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 145/304] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:17.445494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.449334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.486539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50e54-db96-4a0a-b23e-1d678141f58c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.515561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.525468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.526100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.526357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.526629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.527289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:17.527589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.528994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:17.538393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 160/305] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:17.539252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.561740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852c9c2-8fbc-44a3-aa31-7a574021b5eb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.597373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.599044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.599466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.599891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] PATH_INFO: `/v3/users/8eeb692a04894099978d47ed720db24c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.614350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] RBAC: Authorizing `identity:get_user(user_id=8eeb692a04894099978d47ed720db24c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.616108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:17.622774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 146/306] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/users/8eeb692a04894099978d47ed720db24c => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:17.622774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.651987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8b14-0dd7-40aa-942c-82a052621c28 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.689269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.690262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.690934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.691330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.691611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] PATH_INFO: `/v3/groups` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.692278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.693736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:17.708674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 161/307] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Sep 19 11:42:17 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:17.709745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.740350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572a91-c9b7-478c-a54b-f078bc88927a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.767146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.788068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936bd06-f29c-4615-a2a3-f1f7f8f8b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.789017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936bd06-f29c-4615-a2a3-f1f7f8f8b557 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.789017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936bd06-f29c-4615-a2a3-f1f7f8f8b557 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.789308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936bd06-f29c-4615-a2a3-f1f7f8f8b557 None admin] PATH_INFO: `/v3/users/f28a2b5b94ab4aeea97f774f473dd38b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.790493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936bd06-f29c-4615-a2a3-f1f7f8f8b557 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a2b5b94ab4aeea97f774f473dd38b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.791983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936bd06-f29c-4615-a2a3-f1f7f8f8b557 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:17.793817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 147/308] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/users/f28a2b5b94ab4aeea97f774f473dd38b => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:17.799496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f8e2-aa98-4a65-b419-5ceae81bf044 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.799818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f8e2-aa98-4a65-b419-5ceae81bf044 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.800094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f8e2-aa98-4a65-b419-5ceae81bf044 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.803071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 148/309] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:17.803703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f8e2-aa98-4a65-b419-5ceae81bf044 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:17.830789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd9f6-5531-40c4-922d-ac9da6c19078 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.873498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe138-dece-40cf-95ce-a01d2bc5cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.874121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe138-dece-40cf-95ce-a01d2bc5cf64 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.874400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe138-dece-40cf-95ce-a01d2bc5cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.874675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe138-dece-40cf-95ce-a01d2bc5cf64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.875411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe138-dece-40cf-95ce-a01d2bc5cf64 None admin] RBAC: Adding query filter params (role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90, user.id=8eeb692a04894099978d47ed720db24c, scope.system=all) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:17.875716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe138-dece-40cf-95ce-a01d2bc5cf64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.877185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe138-dece-40cf-95ce-a01d2bc5cf64 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:17.883539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 162/310] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Sep 19 11:42:17 2022] GET /identity/v3/role_assignments?user.id=8eeb692a04894099978d47ed720db24c&scope.system=all&role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:17.884748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eceab-4bc9-4851-b15f-4085ffaa85b3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.885041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eceab-4bc9-4851-b15f-4085ffaa85b3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.885344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eceab-4bc9-4851-b15f-4085ffaa85b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.912648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d32eceab-4bc9-4851-b15f-4085ffaa85b3 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:17.913855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d32eceab-4bc9-4851-b15f-4085ffaa85b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:17.938007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f8e2-aa98-4a65-b419-5ceae81bf044 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:17.976858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:17.985339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:17.986101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:17.986388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:17.986660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] PATH_INFO: `/v3/system/users/f28a2b5b94ab4aeea97f774f473dd38b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:17.988368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f28a2b5b94ab4aeea97f774f473dd38b, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:17.990645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:18.003359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 149/311] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Sep 19 11:42:17 2022] PUT /identity/v3/system/users/f28a2b5b94ab4aeea97f774f473dd38b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:18.017762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 163/312] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:18.295139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:18.405114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405d929-7939-40d9-af1d-bbcb36dda581 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:18.440714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:18.441715 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:18.442688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:18.443156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:18.454240 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:18.461124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:18.462141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:18.462946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:18.465174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 150/313] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:18.471245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eceab-4bc9-4851-b15f-4085ffaa85b3 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:18.517896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:18.580607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eceab-4bc9-4851-b15f-4085ffaa85b3 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:18.617033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:18.617850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:18.618219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:18.618587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:18.619353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:18.619750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:18.621212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:18.630261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 164/314] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:18.636166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:18.709264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:18.759405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e8cd4-60db-49d3-96d6-2fad2ec8ef04 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:18.795601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:18.796586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:18.797008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:18.797446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] PATH_INFO: `/v3/users/4f02e2cf1b524b159352626156c89bf8` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:18.798926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] RBAC: Authorizing `identity:get_user(user_id=4f02e2cf1b524b159352626156c89bf8)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:18.800564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:18.802910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 151/315] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:18 2022] GET /identity/v3/users/4f02e2cf1b524b159352626156c89bf8 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:18.808941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:18.914910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110df9db-64d3-4d0d-a0ed-02019bc37283 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:18.929546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:18.950541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:18.951161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:18.951438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:18.951707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:19.026206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:19.027656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:19.130673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 165/316] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:19.136210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:19.244376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ccda6-ddf9-42aa-9dc5-c6f3cd112348 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:19.268241 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:19.281670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17a6a4-70c0-498a-9233-7a3710e98dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:19.282300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17a6a4-70c0-498a-9233-7a3710e98dae None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:19.282577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17a6a4-70c0-498a-9233-7a3710e98dae None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:19.282845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17a6a4-70c0-498a-9233-7a3710e98dae None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:19.283965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17a6a4-70c0-498a-9233-7a3710e98dae None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:19.285416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17a6a4-70c0-498a-9233-7a3710e98dae None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:19.287430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 152/317] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:19 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:19.293349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:19.303434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:19.405847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829e008-913b-49a9-8cac-11bc1049a5bc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:19.441240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6716b-9e9c-4a29-8202-6b886d9ed591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:19.442633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6716b-9e9c-4a29-8202-6b886d9ed591 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:19.443315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6716b-9e9c-4a29-8202-6b886d9ed591 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:19.443726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6716b-9e9c-4a29-8202-6b886d9ed591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:19.444578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6716b-9e9c-4a29-8202-6b886d9ed591 None admin] RBAC: Adding query filter params (role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5, user.id=4f02e2cf1b524b159352626156c89bf8) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:19.445021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6716b-9e9c-4a29-8202-6b886d9ed591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:19.446588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6716b-9e9c-4a29-8202-6b886d9ed591 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:19.452790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 166/318] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:19 2022] GET /identity/v3/role_assignments?user.id=4f02e2cf1b524b159352626156c89bf8&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:19.996263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d2e2-32dd-4771-a001-1feb1591222e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:19.996747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d2e2-32dd-4771-a001-1feb1591222e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:19.996747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d2e2-32dd-4771-a001-1feb1591222e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:19.998219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 153/319] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:20.003369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eb54e-bec6-46bc-9032-b541b84168f7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.003741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eb54e-bec6-46bc-9032-b541b84168f7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.003942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eb54e-bec6-46bc-9032-b541b84168f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.022447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-905eb54e-bec6-46bc-9032-b541b84168f7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:20.023667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-905eb54e-bec6-46bc-9032-b541b84168f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:20.092389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:20.097968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 167/320] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:20.151398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e95a2-0c3c-483e-b786-1045d592c30a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.151690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e95a2-0c3c-483e-b786-1045d592c30a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.151942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e95a2-0c3c-483e-b786-1045d592c30a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.153451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 154/321] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:20.158404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8ee5a-20d9-41a4-8554-a0f4ee4cb7d0 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.158692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8ee5a-20d9-41a4-8554-a0f4ee4cb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.158959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8ee5a-20d9-41a4-8554-a0f4ee4cb7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.182357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-70c8ee5a-20d9-41a4-8554-a0f4ee4cb7d0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:20.183607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-70c8ee5a-20d9-41a4-8554-a0f4ee4cb7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:20.255572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 168/322] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:20.306889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e336b-dd3c-47ed-b590-0d869136c3f2 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.307183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e336b-dd3c-47ed-b590-0d869136c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.307430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e336b-dd3c-47ed-b590-0d869136c3f2 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.308925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 155/323] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:20.313945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d3ae-92e9-4372-824e-a57697c3a7c7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.314232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d3ae-92e9-4372-824e-a57697c3a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.314504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d3ae-92e9-4372-824e-a57697c3a7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.332255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f9a4d3ae-92e9-4372-824e-a57697c3a7c7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:20.334041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f9a4d3ae-92e9-4372-824e-a57697c3a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:20.380521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e336b-dd3c-47ed-b590-0d869136c3f2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:20.404172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 169/324] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:20.483064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e336b-dd3c-47ed-b590-0d869136c3f2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:20.515385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:20.515930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.516205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.516472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.517585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:20.519033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:20.521368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 156/325] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:20.523442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4d3ae-92e9-4372-824e-a57697c3a7c7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:20.526474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:20.584622 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:20.587381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:20.628712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4d3ae-92e9-4372-824e-a57697c3a7c7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:20.630158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adff58-45cd-475a-833a-d59c87726658 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:20.669010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:20.669720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.669995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] PATH_INFO: `/v3/groups` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.670894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:20.671997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:20.672415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:20.672975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.673276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.673544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.685426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:20.689570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 157/326] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Sep 19 11:42:20 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:20.690309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:20.691211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:20.692051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:20.693301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 170/327] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:20.698294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:20.698469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:20.814429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3bbcf-f9cc-4bfb-bab4-7cdb9ca94ec6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:20.825444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4389ac-cfca-4510-a9c5-643457cb0a02 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:20.833633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:20.852747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:20.858967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:20.860067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.860067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.860249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.869874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:20.871137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:20.871137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:20.871137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:20.871658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:20.871957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:20.872747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:20.873351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:20.878162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:20.879039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:20.880614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 158/328] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:20.888026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 171/329] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:20.888234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:20.888876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:21.002330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa414b-8543-4e8c-86cb-0653622904d5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:21.015633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938e15e-eb89-40de-9855-246d81f143d8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:21.044807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:21.045853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:21.045853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:21.046129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:21.047328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:21.047328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:21.049072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:21.056792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:21.058016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:21.058016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:21.058701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 159/330] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:21.059962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] PATH_INFO: `/v3/users/8eeb692a04894099978d47ed720db24c` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:21.061304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=8eeb692a04894099978d47ed720db24c)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:21.064094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:21.064274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:21.065882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 172/331] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:20 2022] GET /identity/v3/users/8eeb692a04894099978d47ed720db24c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:21.074125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:21.112205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:21.135654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:21.193809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd1012-104a-4af6-a21b-c45acf0a9658 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:21.196901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cc56-d7cb-42f3-bd91-631cc47a9aa5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:21.239170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:21.239827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:21.240075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:21.240348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] PATH_INFO: `/v3/users/f28a2b5b94ab4aeea97f774f473dd38b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:21.241512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a2b5b94ab4aeea97f774f473dd38b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:21.242941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:21.243933 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28e1af-e5b9-4098-a4ea-53c0643f18bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:21.244744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e1af-e5b9-4098-a4ea-53c0643f18bd None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:21.244874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 160/332] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:21 2022] GET /identity/v3/users/f28a2b5b94ab4aeea97f774f473dd38b => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:21.245317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e1af-e5b9-4098-a4ea-53c0643f18bd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:21.245741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e1af-e5b9-4098-a4ea-53c0643f18bd None admin] PATH_INFO: `/v3/system/users/8eeb692a04894099978d47ed720db24c/roles/7b9ede94d1c14a66b4ebd4cc6ca2ea90` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:21.247292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28e1af-e5b9-4098-a4ea-53c0643f18bd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8eeb692a04894099978d47ed720db24c, role_id=7b9ede94d1c14a66b4ebd4cc6ca2ea90)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:21.248798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28e1af-e5b9-4098-a4ea-53c0643f18bd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:21.250990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:21.262018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 173/333] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Sep 19 11:42:21 2022] PUT /identity/v3/system/users/8eeb692a04894099978d47ed720db24c/roles/7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:21.377375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d495adc-5b53-41b9-9368-f9313bd7d081 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:21.387984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:21.416870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178dcbf-5f91-4735-9e67-5e4c3751758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:21.417577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178dcbf-5f91-4735-9e67-5e4c3751758d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:21.417851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178dcbf-5f91-4735-9e67-5e4c3751758d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:21.418164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178dcbf-5f91-4735-9e67-5e4c3751758d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:21.418923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178dcbf-5f91-4735-9e67-5e4c3751758d None admin] RBAC: Adding query filter params (role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, user.id=f28a2b5b94ab4aeea97f774f473dd38b, scope.system=all) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:21.419228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178dcbf-5f91-4735-9e67-5e4c3751758d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:21.420700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178dcbf-5f91-4735-9e67-5e4c3751758d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:21.435275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 161/334] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Sep 19 11:42:21 2022] GET /identity/v3/role_assignments?user.id=f28a2b5b94ab4aeea97f774f473dd38b&scope.system=all&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:23.232605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca78d77-2fed-4fad-8185-e84d10bbe206 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:23.233138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca78d77-2fed-4fad-8185-e84d10bbe206 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:23.233138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca78d77-2fed-4fad-8185-e84d10bbe206 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:23.234676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 174/335] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:23.240581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf89c6-7b5a-49ae-869d-2184a86e851a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:23.241027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf89c6-7b5a-49ae-869d-2184a86e851a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:23.241232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf89c6-7b5a-49ae-869d-2184a86e851a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:23.261621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-19cf89c6-7b5a-49ae-869d-2184a86e851a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:23.262819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-19cf89c6-7b5a-49ae-869d-2184a86e851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:23.345819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 162/336] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:23.910137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca78d77-2fed-4fad-8185-e84d10bbe206 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:23.923360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddceef5-2249-40e6-98b9-f7c449cf536d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:23.923686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddceef5-2249-40e6-98b9-f7c449cf536d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:23.923912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddceef5-2249-40e6-98b9-f7c449cf536d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:23.927059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 163/337] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:23.931523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adea41-db15-4992-9c47-470853aeed56 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:23.931799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adea41-db15-4992-9c47-470853aeed56 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:23.932065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adea41-db15-4992-9c47-470853aeed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:23.966134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-21adea41-db15-4992-9c47-470853aeed56 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:23.968507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-21adea41-db15-4992-9c47-470853aeed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:24.090430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca78d77-2fed-4fad-8185-e84d10bbe206 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:24.100311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 164/338] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:24.106035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:24.115366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913e15-5335-4d4e-ab29-a83ac0fa0f36 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.115649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913e15-5335-4d4e-ab29-a83ac0fa0f36 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.115918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913e15-5335-4d4e-ab29-a83ac0fa0f36 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.118057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 165/339] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:24.124572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27919ff1-0346-4608-ab07-75de8db1d173 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.124853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27919ff1-0346-4608-ab07-75de8db1d173 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.125127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27919ff1-0346-4608-ab07-75de8db1d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.154667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:24.155306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.155584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.155858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.157197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-27919ff1-0346-4608-ab07-75de8db1d173 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:24.158411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-27919ff1-0346-4608-ab07-75de8db1d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:24.185844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:24.192007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:24.193033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:24.193862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 175/340] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:24.199147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:24.199505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:24.317634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 166/341] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:24.377555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6780436-9e30-405d-a77e-05f1f2bbda37 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:24.405367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62717-6fde-4bd3-8756-258e1ef0a724 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.405966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62717-6fde-4bd3-8756-258e1ef0a724 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.406500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62717-6fde-4bd3-8756-258e1ef0a724 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.408248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 167/342] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:24.416929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e569-946c-42bd-9b46-80790e0fa5b3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.417495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e569-946c-42bd-9b46-80790e0fa5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.418039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e569-946c-42bd-9b46-80790e0fa5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.420702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:24.421406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.421682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.421952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.422620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:24.423389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:24.425284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:24.433387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 176/343] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:24.439676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:24.466162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-df74e569-946c-42bd-9b46-80790e0fa5b3 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:24.467379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-df74e569-946c-42bd-9b46-80790e0fa5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:24.484662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:24.570627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432640b-cb82-4210-b99d-0171bfead695 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:24.609395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543283c3-f210-4709-8376-665f107884f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:24.610005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543283c3-f210-4709-8376-665f107884f4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.610280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543283c3-f210-4709-8376-665f107884f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.610550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543283c3-f210-4709-8376-665f107884f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.631311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 168/344] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:24.632286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e569-946c-42bd-9b46-80790e0fa5b3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:24.689443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543283c3-f210-4709-8376-665f107884f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:24.691435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543283c3-f210-4709-8376-665f107884f4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:24.741177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:24.786829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:24.807300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e569-946c-42bd-9b46-80790e0fa5b3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:24.826381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 177/345] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:42:24.831690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543283c3-f210-4709-8376-665f107884f4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:24.856605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:24.857300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.857585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.857859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:24.878766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:24.896904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:24.898054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:24.899007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 169/346] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:24.899725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:24.959605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543283c3-f210-4709-8376-665f107884f4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:24.997762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:24.998712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:24.999153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:24.999586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.000877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.002543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.005268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 178/347] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:24 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:25.006510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.011880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.047233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddc651-b50f-4cd7-8fd1-a2cbc7c0d894 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.096172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.097074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.097516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.097984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.115160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f3459-4d6a-4c4c-903c-caf1c319edb2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.115905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:25.121290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:25.122452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:25.123393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:25.129826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 170/348] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:25.130927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.144701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.165491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.166481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.166890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.167294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.168118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:25.168599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.170393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.180372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 179/349] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:25.185782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.261353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c78d-88a4-4d51-b668-f4adbf2e6117 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.274769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.311487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.312437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.312950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.313449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.320892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.323003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.324197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388f287-b473-4ed8-b95f-673a62d70ec7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.325309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 171/350] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:25.326311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.368246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.368977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.369343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.369679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.384893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:25.391644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:25.392535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 180/351] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:25.393334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.413270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.445459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaed73-b5da-4d3b-8079-7aa2b7d2390f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.486505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.487461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.487927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.488408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.489831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:25.490325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.491897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.503735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 172/352] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:25.505687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.532589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca03768-5754-441e-8e19-d77c59b10cad None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.570147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.582589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.583231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.583506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.583787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] PATH_INFO: `/v3/users/8eeb692a04894099978d47ed720db24c` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.585241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] RBAC: Authorizing `identity:get_user(user_id=8eeb692a04894099978d47ed720db24c)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.587250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.588475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 181/353] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/users/8eeb692a04894099978d47ed720db24c => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:25.589671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.622820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8ef1f-a4fe-43bd-b953-98bd1c76a417 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.662317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.670585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.671427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.671908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.672290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.673036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=ac517b9e9caf41319a6fd497a84e8420) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:25.673382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.674819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.681364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 173/354] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:25.682132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.727637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b51e-2dc4-41ff-8d8d-fc581fb00810 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.776649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9e457-5c7c-4e22-9ea2-b3ab42e14c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.777146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e457-5c7c-4e22-9ea2-b3ab42e14c91 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.777444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e457-5c7c-4e22-9ea2-b3ab42e14c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.777710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e457-5c7c-4e22-9ea2-b3ab42e14c91 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.779037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9e457-5c7c-4e22-9ea2-b3ab42e14c91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:25.779037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9e457-5c7c-4e22-9ea2-b3ab42e14c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.780059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9e457-5c7c-4e22-9ea2-b3ab42e14c91 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.792956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 182/355] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:25.795700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0afd7-8c4a-4dde-8191-ec2e7ff7aa38 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.796171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0afd7-8c4a-4dde-8191-ec2e7ff7aa38 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.796591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0afd7-8c4a-4dde-8191-ec2e7ff7aa38 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.804792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 183/356] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:25.806307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0afd7-8c4a-4dde-8191-ec2e7ff7aa38 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:25.820540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624a374-d51c-4446-9b2d-8509aa6d8174 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.862154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c223e7-730d-457a-b8cc-2302fa37c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.862759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c223e7-730d-457a-b8cc-2302fa37c808 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.863122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c223e7-730d-457a-b8cc-2302fa37c808 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.863514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c223e7-730d-457a-b8cc-2302fa37c808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.894116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.949451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0afd7-8c4a-4dde-8191-ec2e7ff7aa38 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:25.951878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:25.961794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c223e7-730d-457a-b8cc-2302fa37c808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.963583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c223e7-730d-457a-b8cc-2302fa37c808 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:25.991345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:25.992065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:25.992527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:25.992803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:25.993576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] RBAC: Adding query filter params (role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90, user.id=8eeb692a04894099978d47ed720db24c, scope.system=all) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:25.993903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:25.995554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:26.010524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 184/357] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/role_assignments?user.id=8eeb692a04894099978d47ed720db24c&scope.system=all&role.id=7b9ede94d1c14a66b4ebd4cc6ca2ea90 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:26.011420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.084483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 174/358] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:26.088535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea210870-519c-4fa2-af47-388549a561de None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.088535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea210870-519c-4fa2-af47-388549a561de None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.088535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea210870-519c-4fa2-af47-388549a561de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.133816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ea210870-519c-4fa2-af47-388549a561de None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:26.135037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ea210870-519c-4fa2-af47-388549a561de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:26.136369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cbdbf-6bcd-4af3-bfe8-dc7477bb8d75 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:26.152766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:26.177599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e28a-6192-4786-a085-c6f7030ede84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:26.178525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e28a-6192-4786-a085-c6f7030ede84 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.178983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e28a-6192-4786-a085-c6f7030ede84 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.179544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e28a-6192-4786-a085-c6f7030ede84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.223626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 175/359] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:26.226567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1db78-ec3d-4b98-a8b2-922e4c08b0d6 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.226922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1db78-ec3d-4b98-a8b2-922e4c08b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.227311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1db78-ec3d-4b98-a8b2-922e4c08b0d6 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.228903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 176/360] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:26.233176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1db78-ec3d-4b98-a8b2-922e4c08b0d6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.261057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e28a-6192-4786-a085-c6f7030ede84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:26.262872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e28a-6192-4786-a085-c6f7030ede84 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:26.267338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:26.372402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1db78-ec3d-4b98-a8b2-922e4c08b0d6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:26.403141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 185/361] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:26.405612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edda929-4b60-4abc-8a90-c49457c2d375 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.405946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edda929-4b60-4abc-8a90-c49457c2d375 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.406381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edda929-4b60-4abc-8a90-c49457c2d375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.423725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:26.424360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.424633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.424900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.426596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:26.427814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1edda929-4b60-4abc-8a90-c49457c2d375 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:26.428526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:26.429068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1edda929-4b60-4abc-8a90-c49457c2d375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:26.430480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 177/362] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:26.431251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.440361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:26.520471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 186/363] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:26.521866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edda929-4b60-4abc-8a90-c49457c2d375 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.541644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:26.550276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f1e4-1106-46e9-a593-523c563ef872 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:26.593183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:26.593822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.594110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.594542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.595550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:26.597041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:26.600619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 178/364] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:26.605977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.651392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edda929-4b60-4abc-8a90-c49457c2d375 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:26.700766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:26.701793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.702283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.702742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.704173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:26.706576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:26.709359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 187/365] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:26.710521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.731806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:26.735109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4506-c749-4d25-ad6c-55f7619c15f3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:26.777001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:26.777751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.778552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.778900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.780092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:26.781826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:26.783470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 179/366] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:26.784418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.826694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:26.849143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e61d2-1d3b-4e03-a6f1-4dc55f2c5665 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:26.894111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:26.895803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.896354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.896822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.908793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:26.914671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:26.915618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:26.916493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:26.917142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ebb25-ed89-42bb-9375-1fdb46f3d744 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:26.918000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 188/367] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:26.918787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:26.961141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:26.961773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:26.962051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:26.962320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:26.963048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=ac517b9e9caf41319a6fd497a84e8420) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:26.964375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:26.965738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:26.971820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 180/368] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:26.972415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:27.012610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:27.054512 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac021-3bc8-4a97-841b-d236a064a900 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:27.088409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:27.097606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07535995-5b27-4d2b-a21c-c9909ab0dad5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:27.102849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:27.103704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:27.104125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:27.104537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:27.106196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:27.106804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:27.108416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:27.116748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 189/369] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:27.117879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:27.142586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:27.146172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:27.146615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:27.146894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:27.173680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:27.182648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:27.183652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:27.184449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:27.188946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 181/370] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:27.198486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:27.331588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263bd9f-6e1d-4616-8e79-f81f372cc3d3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:27.378684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:27.379893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:27.380166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:27.380432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:27.381029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb54c84-e32f-4390-8fa2-de7d708437b6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:27.382541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:27.382541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:27.382804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:27.386314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:27.397490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 190/371] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:27.406321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:27.427977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:27.428919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:27.429514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:27.430019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:27.430912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:27.431412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:27.433079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:27.443148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 182/372] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:27.448431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:27.468839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:27.578845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4feb2b-006d-48cc-a878-bef285f5f532 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:27.594607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00d61c-1744-4a6e-8c13-765fbf90c28f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:27.641856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:27.643007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:27.643283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:27.643549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:27.656206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:27.656459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:27.656737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:27.659228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:27.778122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:27.779508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:27.803062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:27.804852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:27.814497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:27.816079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:27.892690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 183/373] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:27.899021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:27.998022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 191/374] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:28.003529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:28.005896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a62e9-5719-4bf9-b3fc-a24c7a938ff3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:28.042469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:28.043018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.043290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.043555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] PATH_INFO: `/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.044678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] RBAC: Authorizing `identity:get_project(project_id=0ebed357f0fb4f07ab3944407cd5ccdc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:28.046132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:28.048105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 184/375] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:27 2022] GET /identity/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:28.048361 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:28.054140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:28.161983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22590c7a-0dbd-417c-8f96-f25bd0f7eb3e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:28.198978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:28.199616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.199904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.200158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] PATH_INFO: `/v3/groups/fa5199e43174441ba6c6b7f0b92970c8` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.206172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] RBAC: Authorizing `identity:get_group(group_id=fa5199e43174441ba6c6b7f0b92970c8)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:28.208929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:28.211065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 185/376] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:28 2022] GET /identity/v3/groups/fa5199e43174441ba6c6b7f0b92970c8 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:28.217085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:28.236803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:28.243295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506a8de-455a-4fd4-9542-fe4cc7adff76 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:28.277557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:28.302546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:28.303220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.303501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.303774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.305106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:28.306692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:28.308809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 192/377] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:28 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:28.315318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:28.339653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892bf9-fd9d-4265-95ed-68553154e632 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:28.378226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85dbf0-152b-4af8-a7f4-0bbe8c1c3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:28.378828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85dbf0-152b-4af8-a7f4-0bbe8c1c3e58 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.379132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85dbf0-152b-4af8-a7f4-0bbe8c1c3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.379522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85dbf0-152b-4af8-a7f4-0bbe8c1c3e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.380537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85dbf0-152b-4af8-a7f4-0bbe8c1c3e58 None admin] RBAC: Adding query filter params (group.id=fa5199e43174441ba6c6b7f0b92970c8, role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=0ebed357f0fb4f07ab3944407cd5ccdc) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:28.380885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85dbf0-152b-4af8-a7f4-0bbe8c1c3e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:28.382495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85dbf0-152b-4af8-a7f4-0bbe8c1c3e58 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:28.389267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 186/378] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:28 2022] GET /identity/v3/role_assignments?group.id=fa5199e43174441ba6c6b7f0b92970c8&scope.project.id=0ebed357f0fb4f07ab3944407cd5ccdc&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:28.441867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2490-5f23-4bf6-8385-60dfb52af0d8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.442320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2490-5f23-4bf6-8385-60dfb52af0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.442854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2490-5f23-4bf6-8385-60dfb52af0d8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.444433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 187/379] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:28.454355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92697-4d00-4696-a3b5-14f25c4278a1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.454649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92697-4d00-4696-a3b5-14f25c4278a1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.454803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92697-4d00-4696-a3b5-14f25c4278a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.465978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37619f-8966-4aaa-b4fb-c3c0be63b6f7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:28.491377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4da92697-4d00-4696-a3b5-14f25c4278a1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:28.492607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4da92697-4d00-4696-a3b5-14f25c4278a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:28.505700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:28.506353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.506633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.506909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.508596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:28.510244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:28.513376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 193/380] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:28 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:28.518516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:28.565642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:28.638874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512fe03-44e6-4b9b-b59c-a1937ace55cb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:28.682505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:28.683122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:28.683402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:28.683675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:28.684412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:28.684720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:28.686170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:28.699255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 194/381] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:28 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:28.708566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 188/382] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:29.031872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:29.153239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06d59b-4500-4b98-ad5d-32e6e9ae8645 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:29.162107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:29.209294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:29.209945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:29.210222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:29.210494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:29.226421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:29.231393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:29.232254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:29.233042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 195/383] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:29.239107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92697-4d00-4696-a3b5-14f25c4278a1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:29.292475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:29.365274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92697-4d00-4696-a3b5-14f25c4278a1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:29.405145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:29.405787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:29.406088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:29.406413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:29.407097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:29.407399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:29.408848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:29.418091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 189/384] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:29.423265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:29.535575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649c1e5-644f-4d59-ad47-7f5fc85a061b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:29.576262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:29.576908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:29.577205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:29.577488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:29.578631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:29.580062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:29.581967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 196/385] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:29 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:29.587247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:29.735131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ada42c-45f3-4d57-a835-0fb838ab5091 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:29.737668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:29.790686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c7b89-6947-4cbf-afe1-3e3131161654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:29.791343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c7b89-6947-4cbf-afe1-3e3131161654 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:29.791619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c7b89-6947-4cbf-afe1-3e3131161654 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:29.791941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c7b89-6947-4cbf-afe1-3e3131161654 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:29.793264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c7b89-6947-4cbf-afe1-3e3131161654 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:29.794743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c7b89-6947-4cbf-afe1-3e3131161654 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:29.796467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 190/386] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:29 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:29.803053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:29.833247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:29.919387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e604bb6-ad7d-43da-9382-a0260dc1ae64 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:29.919728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e604bb6-ad7d-43da-9382-a0260dc1ae64 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:29.919995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e604bb6-ad7d-43da-9382-a0260dc1ae64 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:29.921633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 191/387] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:29.927008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2573-5a97-4bd7-9672-55ead05380ed None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:29.927310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045ff56-1fdf-4058-9812-2d08c422f27e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:29.927553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045ff56-1fdf-4058-9812-2d08c422f27e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:29.927833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045ff56-1fdf-4058-9812-2d08c422f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:29.965508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4045ff56-1fdf-4058-9812-2d08c422f27e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:29.966938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4045ff56-1fdf-4058-9812-2d08c422f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:29.994435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012ac44-05d2-4b67-8a00-7877077e374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:29.995105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ac44-05d2-4b67-8a00-7877077e374e None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:29.995379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ac44-05d2-4b67-8a00-7877077e374e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:29.995646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012ac44-05d2-4b67-8a00-7877077e374e None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420/groups/36661bd8c7844b8088ba02c8602b9afa/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:29.999137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ac44-05d2-4b67-8a00-7877077e374e None admin] RBAC: Authorizing `identity:create_grant(project_id=ac517b9e9caf41319a6fd497a84e8420, group_id=36661bd8c7844b8088ba02c8602b9afa, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:30.000560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012ac44-05d2-4b67-8a00-7877077e374e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:30.021431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 197/388] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Sep 19 11:42:29 2022] PUT /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420/groups/36661bd8c7844b8088ba02c8602b9afa/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:42:30.080815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 192/389] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:30.251023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22514a-f37e-4203-9760-29d48dff59db None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:30.251197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22514a-f37e-4203-9760-29d48dff59db None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:30.251480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22514a-f37e-4203-9760-29d48dff59db None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:30.253207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 198/390] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:30.259345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4824c-3be5-4d09-af8a-1816c534de8a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:30.259635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4824c-3be5-4d09-af8a-1816c534de8a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:30.259912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4824c-3be5-4d09-af8a-1816c534de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:30.281998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f0d4824c-3be5-4d09-af8a-1816c534de8a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:30.283237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f0d4824c-3be5-4d09-af8a-1816c534de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:30.375155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 193/391] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:30.494168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22514a-f37e-4203-9760-29d48dff59db None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:30.611352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:30.628683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22514a-f37e-4203-9760-29d48dff59db None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:30.682399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:30.683035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:30.683313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:30.683583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:30.702431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:30.708587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:30.709547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:30.710328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 199/392] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:30.715934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4824c-3be5-4d09-af8a-1816c534de8a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:30.758242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:30.844697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4824c-3be5-4d09-af8a-1816c534de8a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:30.854328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:30.919246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:30.919787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:30.920061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:30.920333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:30.921009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:30.921336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:30.922717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:30.936432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 194/393] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:30.942223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:31.044310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dba078-3abb-4478-9734-ef8f72aeebe8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:31.114929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:31.115574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.115849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.116112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.118306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:31.128439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee130ac-4663-4f71-910c-028f8db7c08c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:31.135765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:31.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:31.143805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:31.144687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:31.149395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 200/394] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:31.158249 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:31.173586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:31.181042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:31.181746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.182030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.182306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.183505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:31.184912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:31.186824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 195/395] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:30 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:31.192825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:31.346896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae755a80-336d-4aea-a905-e416b22ee774 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:31.390146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:31.390590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be816c9-a34c-40f7-be04-916e0702400f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:31.390833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.391113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.391387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.392958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:31.395589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:31.397753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 196/396] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:31 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:31.404447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:31.444951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:31.472538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:31.473342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.474096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.474432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.475103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:31.475418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:31.476771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:31.497524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 201/397] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:31.513657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:31.549041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae57a3-7048-4c73-b6c1-988a318e1475 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:31.596635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196b7e5-1a11-4275-bb03-67cceba47e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:31.598309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196b7e5-1a11-4275-bb03-67cceba47e7d None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.598992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196b7e5-1a11-4275-bb03-67cceba47e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.599702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196b7e5-1a11-4275-bb03-67cceba47e7d None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420/groups/36661bd8c7844b8088ba02c8602b9afa/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.602549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196b7e5-1a11-4275-bb03-67cceba47e7d None admin] RBAC: Authorizing `identity:create_grant(project_id=ac517b9e9caf41319a6fd497a84e8420, group_id=36661bd8c7844b8088ba02c8602b9afa, role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:31.604440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196b7e5-1a11-4275-bb03-67cceba47e7d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:31.619110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:31.626998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 197/398] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Sep 19 11:42:31 2022] PUT /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420/groups/36661bd8c7844b8088ba02c8602b9afa/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:42:31.628504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8a81-3746-4c07-8a88-66e4da05ca07 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.628837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8a81-3746-4c07-8a88-66e4da05ca07 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.633338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8a81-3746-4c07-8a88-66e4da05ca07 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.640380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 198/399] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:31.647674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1704bf9-b300-43c2-b7af-9beeca44f651 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.648151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1704bf9-b300-43c2-b7af-9beeca44f651 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.648255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1704bf9-b300-43c2-b7af-9beeca44f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.673192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a1704bf9-b300-43c2-b7af-9beeca44f651 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:31.674416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec6e3-61a5-4304-ab21-09a20717930c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:31.674528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a1704bf9-b300-43c2-b7af-9beeca44f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:31.721597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62a062-8af9-43df-83b8-ddf92ec6a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:31.722161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a062-8af9-43df-83b8-ddf92ec6a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.722439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a062-8af9-43df-83b8-ddf92ec6a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.723369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a062-8af9-43df-83b8-ddf92ec6a2a2 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.725316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62a062-8af9-43df-83b8-ddf92ec6a2a2 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:31.726835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62a062-8af9-43df-83b8-ddf92ec6a2a2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:31.728854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 202/400] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:31 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:31.730282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51baef3-a122-4793-b500-64e5d1db7072 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.730564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51baef3-a122-4793-b500-64e5d1db7072 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.730888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51baef3-a122-4793-b500-64e5d1db7072 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.732391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 203/401] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:31.738091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51baef3-a122-4793-b500-64e5d1db7072 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:31.773880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 199/402] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:31.781257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52facaf4-d652-4e78-b783-5f1f4eb32089 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.782048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52facaf4-d652-4e78-b783-5f1f4eb32089 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.782650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52facaf4-d652-4e78-b783-5f1f4eb32089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.806702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-52facaf4-d652-4e78-b783-5f1f4eb32089 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:31.808256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-52facaf4-d652-4e78-b783-5f1f4eb32089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:31.831935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:31.908360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 200/403] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:31.922584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51baef3-a122-4793-b500-64e5d1db7072 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:31.961032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:31.961818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:31.962094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:31.962365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:31.963534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:31.964965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:31.971306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 204/404] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:31 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:31.974498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52facaf4-d652-4e78-b783-5f1f4eb32089 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.112518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52facaf4-d652-4e78-b783-5f1f4eb32089 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:32.148841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:32.149526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:32.149873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:32.150142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/groups/36661bd8c7844b8088ba02c8602b9afa/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:32.152066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] RBAC: Authorizing `identity:create_grant(project_id=921a065cbcb549c8ab5a2a774192ebc5, group_id=36661bd8c7844b8088ba02c8602b9afa, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:32.153589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:32.164174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.173094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:32.180999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 201/405] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Sep 19 11:42:31 2022] PUT /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/groups/36661bd8c7844b8088ba02c8602b9afa/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:32.242591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.256053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:32.324566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59719129-a91b-4acb-bb8b-145997a241ed None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:32.373896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:32.374615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:32.374898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:32.375173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:32.397900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892481c1-c8fb-4277-b090-24cbb064bd06 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:32.399859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:32.413559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:32.414504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:32.415279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 205/406] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:32.422525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.440677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:32.441499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:32.442474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:32.443102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:32.454960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:32.460960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:32.463235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:32.465105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 202/407] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:32.472199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.528204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:32.575068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124fa7d-ed82-435d-ae3b-641484d0b602 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:32.575413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:32.617450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:32.618114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:32.618399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:32.618675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:32.619353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:32.619942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1444b0-32fa-42a9-bfb6-12742faa3b0f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:32.620099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:32.621023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:32.630597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 206/408] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:32.638574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.672312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:32.673100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:32.673418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:32.673744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:32.674414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:32.674709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:32.676267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:32.685930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 203/409] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:32.698148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.783687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d2b7-aa80-450f-af96-ab29212b3bca None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:32.811032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:32.822674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:32.823318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:32.823602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:32.823881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] PATH_INFO: `/v3/groups/fa5199e43174441ba6c6b7f0b92970c8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:32.825212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] RBAC: Authorizing `identity:get_group(group_id=fa5199e43174441ba6c6b7f0b92970c8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:32.827907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:32.831396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 207/410] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:32 2022] GET /identity/v3/groups/fa5199e43174441ba6c6b7f0b92970c8 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:32.837018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:32.912543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb28b-f08d-4061-b6dd-69b94b5420a6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:32.973607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:32.981109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:32.981781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:32.982070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:32.982347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:32.988829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:32.992851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:32.997232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 204/411] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:32 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:33.003172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:33.063204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01dc07-7d4e-4837-85a7-95647618c7b8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:33.104150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b90dfb-a54c-432e-853a-ace2ce274cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:33.104819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90dfb-a54c-432e-853a-ace2ce274cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:33.105356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90dfb-a54c-432e-853a-ace2ce274cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:33.105636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90dfb-a54c-432e-853a-ace2ce274cf6 None admin] PATH_INFO: `/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:33.106885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b90dfb-a54c-432e-853a-ace2ce274cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=0ebed357f0fb4f07ab3944407cd5ccdc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:33.108433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b90dfb-a54c-432e-853a-ace2ce274cf6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:33.110989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 208/412] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:32 2022] GET /identity/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc => generated 344 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:33.113804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac478a-617b-47c8-be09-5014c5d5598b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:33.114318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac478a-617b-47c8-be09-5014c5d5598b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:33.114737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac478a-617b-47c8-be09-5014c5d5598b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:33.120394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 209/413] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:33.120394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac478a-617b-47c8-be09-5014c5d5598b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:33.162105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc126-7557-4f45-a644-37959c611e4f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:33.198733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abfef0-2212-4cde-9694-b1e8488995e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:33.199707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfef0-2212-4cde-9694-b1e8488995e9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:33.200167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:33.200628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfef0-2212-4cde-9694-b1e8488995e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:33.201427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfef0-2212-4cde-9694-b1e8488995e9 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:33.202772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abfef0-2212-4cde-9694-b1e8488995e9 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:33.204798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abfef0-2212-4cde-9694-b1e8488995e9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:33.212455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 205/414] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:33 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:33.214042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7e3f-7834-4813-b2b6-f7131765d326 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:33.214507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7e3f-7834-4813-b2b6-f7131765d326 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:33.214980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7e3f-7834-4813-b2b6-f7131765d326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:33.235108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-774e7e3f-7834-4813-b2b6-f7131765d326 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:33.236724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-774e7e3f-7834-4813-b2b6-f7131765d326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:33.245530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac478a-617b-47c8-be09-5014c5d5598b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:33.289355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:33.290019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:33.290331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:33.290673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] PATH_INFO: `/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc/groups/fa5199e43174441ba6c6b7f0b92970c8/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:33.292579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] RBAC: Authorizing `identity:create_grant(project_id=0ebed357f0fb4f07ab3944407cd5ccdc, group_id=fa5199e43174441ba6c6b7f0b92970c8, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:33.294827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:33.312117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:33.314228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 210/415] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Sep 19 11:42:33 2022] PUT /identity/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc/groups/fa5199e43174441ba6c6b7f0b92970c8/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:33.315721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:33.325877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 206/416] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:33.435028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ed28-24d8-4451-9508-608d8ff9329a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:33.461070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:33.474557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:33.475238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:33.475520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:33.475803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/groups/36661bd8c7844b8088ba02c8602b9afa/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:33.478391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] RBAC: Authorizing `identity:create_grant(project_id=921a065cbcb549c8ab5a2a774192ebc5, group_id=36661bd8c7844b8088ba02c8602b9afa, role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:33.479953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:33.499508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 211/417] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Sep 19 11:42:33 2022] PUT /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5/groups/36661bd8c7844b8088ba02c8602b9afa/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:33.695211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7e3f-7834-4813-b2b6-f7131765d326 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:33.827015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7e3f-7834-4813-b2b6-f7131765d326 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:33.863036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:33.864367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:33.864651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:33.864926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:33.877573 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:33.883077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:33.883943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:33.884721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 207/418] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:33.890056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:34.039095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8135-0467-45b7-82ea-f3bde123daba None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:34.073466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a1e4a-6b5f-4d87-a03c-9b948ccefe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:34.074076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a1e4a-6b5f-4d87-a03c-9b948ccefe63 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:34.074354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a1e4a-6b5f-4d87-a03c-9b948ccefe63 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:34.074624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a1e4a-6b5f-4d87-a03c-9b948ccefe63 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:34.075293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a1e4a-6b5f-4d87-a03c-9b948ccefe63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:34.075598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a1e4a-6b5f-4d87-a03c-9b948ccefe63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:34.076968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a1e4a-6b5f-4d87-a03c-9b948ccefe63 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:34.085599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 212/419] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:34.090872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:34.196614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:34.253279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66046-09f9-4e74-b68e-5815febcfc90 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:34.253610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66046-09f9-4e74-b68e-5815febcfc90 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:34.254376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66046-09f9-4e74-b68e-5815febcfc90 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:34.255985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 213/420] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:34.261285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00bcf-da23-4694-b4d4-e751075fc7ba None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:34.274576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2f66-20e0-44a4-a3a0-79fadadde8db None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:34.274890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2f66-20e0-44a4-a3a0-79fadadde8db None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:34.275117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2f66-20e0-44a4-a3a0-79fadadde8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:34.310340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e3db2f66-20e0-44a4-a3a0-79fadadde8db None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:34.312475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e3db2f66-20e0-44a4-a3a0-79fadadde8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:34.328296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:34.328909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:34.329207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:34.329488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:34.383381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:34.416256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 214/421] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:34.452478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:34.454048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:34.517517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:34.571743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 208/422] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:34.577031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2f66-20e0-44a4-a3a0-79fadadde8db None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:34.712002 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2f66-20e0-44a4-a3a0-79fadadde8db None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:34.760599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:34.761265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:34.761544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:34.761812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:34.762954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:34.764375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:34.766305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 215/423] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:34 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:34.772097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:34.808254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:34.901594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:34.908717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcf361-2b5e-423b-b0e2-9f0d3d92e453 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:34.949057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:34.950820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:34.950820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:34.950820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:34.953184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:34.953184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:34.956652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 209/424] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:34 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:34.963514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:34.996224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e33b4-de3f-4e4d-8d23-d1a3527ce127 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:35.012918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:35.041012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152457a7-071a-4545-b8fe-d826eef1509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:35.041692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152457a7-071a-4545-b8fe-d826eef1509e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.041970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152457a7-071a-4545-b8fe-d826eef1509e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.042625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152457a7-071a-4545-b8fe-d826eef1509e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.056397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152457a7-071a-4545-b8fe-d826eef1509e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-152457a7-071a-4545-b8fe-d826eef1509e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:35.063537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:35.065313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:35.067806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 216/425] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:35.071310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9783-5a0d-4187-876c-1fd0758af1b4 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.071623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9783-5a0d-4187-876c-1fd0758af1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.071875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9783-5a0d-4187-876c-1fd0758af1b4 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.074001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 217/426] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:35.074729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9783-5a0d-4187-876c-1fd0758af1b4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:35.126153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7356311-ad81-4ff8-bf3f-b0213dfd1907 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:35.171560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e1a43-3959-4b4e-8a17-c2586465b2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:35.173323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1a43-3959-4b4e-8a17-c2586465b2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.173855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1a43-3959-4b4e-8a17-c2586465b2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.174265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1a43-3959-4b4e-8a17-c2586465b2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.175141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e1a43-3959-4b4e-8a17-c2586465b2b6 None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=ac517b9e9caf41319a6fd497a84e8420) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:35.175611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e1a43-3959-4b4e-8a17-c2586465b2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:35.177988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e1a43-3959-4b4e-8a17-c2586465b2b6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:35.193396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 210/427] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:34 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:35.193396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812251f7-81db-441b-a153-5b43db0ce480 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.193396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812251f7-81db-441b-a153-5b43db0ce480 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.193396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812251f7-81db-441b-a153-5b43db0ce480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.221460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-812251f7-81db-441b-a153-5b43db0ce480 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:35.225248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-812251f7-81db-441b-a153-5b43db0ce480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:35.240615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9783-5a0d-4187-876c-1fd0758af1b4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:35.242672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:35.310020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:35.311086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.311623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.312185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.313182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:35.313704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:35.315316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:35.330709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 211/428] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:35.332641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 218/429] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:35.343329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812251f7-81db-441b-a153-5b43db0ce480 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:35.375302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:35.461044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812251f7-81db-441b-a153-5b43db0ce480 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:35.496578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:35.497211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.497498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.497773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.569614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:35.571087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:35.594068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:35.679010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 212/430] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:35.684776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:35.688436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:35.836036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9168c-414e-41b9-bc55-2e4a546da5c7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:35.843310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f818-7d70-4365-83f7-b2d7f9633902 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:35.865387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:35.888010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:35.888950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.889432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.890106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.895983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:35.896858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:35.897329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:35.897741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] PATH_INFO: `/v3/projects/ac517b9e9caf41319a6fd497a84e8420` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:35.899305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] RBAC: Authorizing `identity:get_project(project_id=ac517b9e9caf41319a6fd497a84e8420)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:35.901230 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:35.903732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 219/431] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:35 2022] GET /identity/v3/projects/ac517b9e9caf41319a6fd497a84e8420 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:35.910063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:35.910739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:35.917040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:35.918193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:42:35.919218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:35.920826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 213/432] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:35.928689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:35.960996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.065121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d900-6da1-4579-be5e-66080da342c8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.083351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58889-d90d-4f1f-82ae-4c4dd8229d01 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.114477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a721-3032-4a3d-8c50-749dde1342e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.114477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a721-3032-4a3d-8c50-749dde1342e3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.114477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a721-3032-4a3d-8c50-749dde1342e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.114477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a721-3032-4a3d-8c50-749dde1342e3 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.115948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a721-3032-4a3d-8c50-749dde1342e3 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:36.117472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a721-3032-4a3d-8c50-749dde1342e3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:36.119350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 220/433] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:35 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:36.120412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334fc6-9f45-4961-b8cc-ec763c9d92f9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.120691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334fc6-9f45-4961-b8cc-ec763c9d92f9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.120962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334fc6-9f45-4961-b8cc-ec763c9d92f9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.122611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 221/434] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:36.125202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17334fc6-9f45-4961-b8cc-ec763c9d92f9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.146006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707c33-1374-443e-b0ed-b11f9fd2f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.147568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707c33-1374-443e-b0ed-b11f9fd2f60e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.147992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707c33-1374-443e-b0ed-b11f9fd2f60e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.148419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707c33-1374-443e-b0ed-b11f9fd2f60e None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.149308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc707c33-1374-443e-b0ed-b11f9fd2f60e None admin] RBAC: Adding query filter params (name=member) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:36.149746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc707c33-1374-443e-b0ed-b11f9fd2f60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:36.151254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc707c33-1374-443e-b0ed-b11f9fd2f60e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:36.161720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 214/435] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:36.163258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a451d5-550a-42fe-8c88-1217b8081c4d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.163716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a451d5-550a-42fe-8c88-1217b8081c4d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.164127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a451d5-550a-42fe-8c88-1217b8081c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.185624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f5a451d5-550a-42fe-8c88-1217b8081c4d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:36.187193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f5a451d5-550a-42fe-8c88-1217b8081c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:36.228086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.248560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.252681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17334fc6-9f45-4961-b8cc-ec763c9d92f9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.260374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 215/436] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:36.261244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a451d5-550a-42fe-8c88-1217b8081c4d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.289493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c47141-7ef2-430a-8220-e5cd3b4cad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.290094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47141-7ef2-430a-8220-e5cd3b4cad2f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.290370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47141-7ef2-430a-8220-e5cd3b4cad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.290638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47141-7ef2-430a-8220-e5cd3b4cad2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.291363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c47141-7ef2-430a-8220-e5cd3b4cad2f None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=ac517b9e9caf41319a6fd497a84e8420) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:36.291668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c47141-7ef2-430a-8220-e5cd3b4cad2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:36.293086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c47141-7ef2-430a-8220-e5cd3b4cad2f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:36.299663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 222/437] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=ac517b9e9caf41319a6fd497a84e8420&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:36.301050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f0b6-a0e3-4acc-bf4d-97cd490a827f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.301478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f0b6-a0e3-4acc-bf4d-97cd490a827f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.301877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f0b6-a0e3-4acc-bf4d-97cd490a827f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.303569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 223/438] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:36.309218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642084-551c-4cd1-8c04-b61b02aff8c9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.309579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642084-551c-4cd1-8c04-b61b02aff8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.309960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642084-551c-4cd1-8c04-b61b02aff8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.333225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a3642084-551c-4cd1-8c04-b61b02aff8c9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:36.334663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a3642084-551c-4cd1-8c04-b61b02aff8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:36.385392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a451d5-550a-42fe-8c88-1217b8081c4d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.429333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 224/439] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:36.432980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.433857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.434366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.434865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.486586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.517631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:36.519392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:36.533347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642084-551c-4cd1-8c04-b61b02aff8c9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.642692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 216/440] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:36.648945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.664111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.673670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642084-551c-4cd1-8c04-b61b02aff8c9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.719303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.720870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.721166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.721532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.733282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:36.738610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:36.739909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 225/441] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:36.740715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.749543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.782585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228a8d-774b-4a25-8529-fb0ce20c7384 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.820635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.821298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.821594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.821863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.822972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:36.824391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:36.826017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 217/442] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:36.826772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.856147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54e5aa-468f-4a43-921b-c6a640243038 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.891611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.892227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.892505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.892826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.902802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:36.907550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:36.908841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 226/443] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:36.909712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.925294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.929565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9592ba-8b2d-4ec7-92d9-aaa5d2844415 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:36.962965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:36.963559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:36.963833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:36.964102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:36.964762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:36.965063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:36.966452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:36.974675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 218/444] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:36.975447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:36.977944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.011914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a77cc-f6a6-4452-825f-18d3d5bbb938 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.044561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.045202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.045483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.045755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.046864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.048300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.049877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 227/445] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:37.051180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.075522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d497-b2bf-463b-9c30-a9a531ed7797 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.109571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.110266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.110539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.110813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.111473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:37.111770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.113202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.121698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 219/446] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:37.122494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.133874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.154049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec1378-3699-43c2-9142-5ec5d5247f22 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.182619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.188948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.189492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.189768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.190031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.221697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de694f9-b6e5-4932-b6b4-ab46fc5fd4f9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.255939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.256589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.256865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.257129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.257579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.257872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=3af5b9ea5a3e4431b95b13af8fbfb03e, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:37.258173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.259025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.259581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.265066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 220/447] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=3af5b9ea5a3e4431b95b13af8fbfb03e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:37.265854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.355943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.379963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 228/448] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:37.385522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.396556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b89d3-a19d-4dc6-be1f-97509e231e32 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.425329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.435575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.436187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.436466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.436737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.507030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b09a-2d25-4f42-9461-7a3b0570fa3d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.517651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.519125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.552842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.553545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.553817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.554088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] PATH_INFO: `/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.555231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0ebed357f0fb4f07ab3944407cd5ccdc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.556693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.558361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 229/449] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/projects/0ebed357f0fb4f07ab3944407cd5ccdc => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:37.563759 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.623920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.632234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 221/450] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:37.638686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.668962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.684052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f88a2-546b-4296-9c78-7e68dcf503a4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.718895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.719517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.719795 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.720066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] PATH_INFO: `/v3/groups/fa5199e43174441ba6c6b7f0b92970c8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.721235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] RBAC: Authorizing `identity:get_group(group_id=fa5199e43174441ba6c6b7f0b92970c8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.722720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.724518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 230/451] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/groups/fa5199e43174441ba6c6b7f0b92970c8 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:37.730208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.740366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c24a-a139-404e-9f4a-1cee49ec60ba None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.774482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.775113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.775387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.775657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] PATH_INFO: `/v3/projects/921a065cbcb549c8ab5a2a774192ebc5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.776771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] RBAC: Authorizing `identity:get_project(project_id=921a065cbcb549c8ab5a2a774192ebc5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.778238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.779836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 222/452] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/projects/921a065cbcb549c8ab5a2a774192ebc5 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:37.785299 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:37.831490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894663-7229-4eb5-82f3-df7f3e568865 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.848725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.865934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a084929-772c-4597-bced-a53c652756bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.866528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084929-772c-4597-bced-a53c652756bb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.866806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084929-772c-4597-bced-a53c652756bb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.867074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084929-772c-4597-bced-a53c652756bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.867794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a084929-772c-4597-bced-a53c652756bb None admin] RBAC: Adding query filter params (group.id=fa5199e43174441ba6c6b7f0b92970c8, role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=0ebed357f0fb4f07ab3944407cd5ccdc) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:37.868097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a084929-772c-4597-bced-a53c652756bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.869533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a084929-772c-4597-bced-a53c652756bb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.875206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 231/453] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/role_assignments?group.id=fa5199e43174441ba6c6b7f0b92970c8&scope.project.id=0ebed357f0fb4f07ab3944407cd5ccdc&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:37.876968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:37.883565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8568c88-c54c-41e9-8d83-5481084e6cee None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:37.920548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d1d04-6321-4cbe-ae21-75de82b64c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:37.921214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d1d04-6321-4cbe-ae21-75de82b64c19 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:37.921493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d1d04-6321-4cbe-ae21-75de82b64c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:37.921760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d1d04-6321-4cbe-ae21-75de82b64c19 None admin] PATH_INFO: `/v3/groups/36661bd8c7844b8088ba02c8602b9afa` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:37.922897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d1d04-6321-4cbe-ae21-75de82b64c19 None admin] RBAC: Authorizing `identity:get_group(group_id=36661bd8c7844b8088ba02c8602b9afa)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:37.924369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d1d04-6321-4cbe-ae21-75de82b64c19 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:37.926187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 223/454] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/groups/36661bd8c7844b8088ba02c8602b9afa => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:37.933043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a084929-772c-4597-bced-a53c652756bb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:38.039352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a084929-772c-4597-bced-a53c652756bb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:38.077175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f716376-00ba-43aa-9428-322fe24443e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:38.077175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f716376-00ba-43aa-9428-322fe24443e0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:38.077175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f716376-00ba-43aa-9428-322fe24443e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:38.077175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f716376-00ba-43aa-9428-322fe24443e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:38.077618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f716376-00ba-43aa-9428-322fe24443e0 None admin] RBAC: Adding query filter params (group.id=36661bd8c7844b8088ba02c8602b9afa, role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=921a065cbcb549c8ab5a2a774192ebc5) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:38.077618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f716376-00ba-43aa-9428-322fe24443e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:38.077618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f716376-00ba-43aa-9428-322fe24443e0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:38.084094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 232/455] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Sep 19 11:42:37 2022] GET /identity/v3/role_assignments?group.id=36661bd8c7844b8088ba02c8602b9afa&scope.project.id=921a065cbcb549c8ab5a2a774192ebc5&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:41.004268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc202-036e-4fcb-bfee-1740f2af6ff6 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.005314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc202-036e-4fcb-bfee-1740f2af6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.005814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc202-036e-4fcb-bfee-1740f2af6ff6 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.007770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 224/456] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:41.013689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32307-a85d-4b7e-916e-b2df57881efe None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.014699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32307-a85d-4b7e-916e-b2df57881efe None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.015185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32307-a85d-4b7e-916e-b2df57881efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.036703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-48d32307-a85d-4b7e-916e-b2df57881efe None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:41.038263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-48d32307-a85d-4b7e-916e-b2df57881efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:41.087884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:41.127031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 233/457] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:41.223600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172f9a8-2d5a-4fe2-aee9-dea405b76b88 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.224500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172f9a8-2d5a-4fe2-aee9-dea405b76b88 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.224967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172f9a8-2d5a-4fe2-aee9-dea405b76b88 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.226808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 225/458] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:41.238669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac55e02-81ae-484b-b566-ce4a141653cc None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.238858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c33ad3-471b-4fc3-89c9-0fb6996cb0b7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.238971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac55e02-81ae-484b-b566-ce4a141653cc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.239212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac55e02-81ae-484b-b566-ce4a141653cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.239686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c33ad3-471b-4fc3-89c9-0fb6996cb0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.240163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c33ad3-471b-4fc3-89c9-0fb6996cb0b7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.242009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 234/459] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:41.246664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8cf3-f7c8-46d9-a00f-b8e5979cc525 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.247421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8cf3-f7c8-46d9-a00f-b8e5979cc525 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.248836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8cf3-f7c8-46d9-a00f-b8e5979cc525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.266071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7ac55e02-81ae-484b-b566-ce4a141653cc None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:41.267196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7ac55e02-81ae-484b-b566-ce4a141653cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:41.281975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7bba8cf3-f7c8-46d9-a00f-b8e5979cc525 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:41.283153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7bba8cf3-f7c8-46d9-a00f-b8e5979cc525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:41.388080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 226/460] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:41.411037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 235/461] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:41.467182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac55e02-81ae-484b-b566-ce4a141653cc None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:41.590724 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8aca-0520-4bdc-be5e-45406213d6bd None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.591072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8aca-0520-4bdc-be5e-45406213d6bd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.591274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8aca-0520-4bdc-be5e-45406213d6bd None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.592810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 236/462] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:41.598432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cc6d1-6356-4d2b-9324-c4f4ed089d1d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.599189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cc6d1-6356-4d2b-9324-c4f4ed089d1d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.599468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cc6d1-6356-4d2b-9324-c4f4ed089d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.606216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac55e02-81ae-484b-b566-ce4a141653cc None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:41.613979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:41.632397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5c8cc6d1-6356-4d2b-9324-c4f4ed089d1d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:41.633715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5c8cc6d1-6356-4d2b-9324-c4f4ed089d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:41.687584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:41.688276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.688554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.688818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.710632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:41.712083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:41.733785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 237/463] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:41.734641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cc6d1-6356-4d2b-9324-c4f4ed089d1d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:41.740920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:41.741848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:41.742818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:41.742818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:41.742818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:41.742818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 227/464] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:41.758138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:41.775747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:41.849255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cc6d1-6356-4d2b-9324-c4f4ed089d1d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:41.886537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:41.887156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.887429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.887694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.898380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:41.899887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:41.901407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a7e6-cebb-4c28-bc09-0ebd66b80aeb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:41.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:41.916276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:41.917744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:41.917744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:41.917744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:41.917744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 238/465] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:41.917744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:41.944461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:41.945498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:41.946036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:41.946308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:41.947200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:41.947524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:41.949537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:41.973177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 228/466] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:41.974421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:41.985032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:42.024037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:42.040278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2ea7d-7cc3-4667-bfd5-627d862ff7ef None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.081501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.082640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.083107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.083382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.090288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5991950-3c15-486d-8e6b-032886b99550 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.094626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.096063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:42.111620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:42.112528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:42.113945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:42.113945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:42.113945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:42.113945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 239/467] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:42.114165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:42.131779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.132323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.132598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.132957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.133536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:42.133832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.135190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.148260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 229/468] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:42.148973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:42.221733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:42.231686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356945-88b1-4e2a-8efb-3ea794f2b7bc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.259796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a613f6-d1dc-48c3-b7c1-dfaa5107152e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.267304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.267898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.268172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.268435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.269068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.271340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.283452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:42.295987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.296641 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.296917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.297213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.299472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 240/469] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:42 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:42.307182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:42.316251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.319959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:42.344467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:42.345500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:42.346320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:42.346320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:42.346320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:42.350243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 230/470] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:42.351347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:42.444421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216c46d-1020-4407-8298-364cac7b3a11 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.483756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.484838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.484838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.485027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.486561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:42.486561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.487224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.491099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69c84-cbb7-4640-922a-a342dd48b11e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.500546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 241/471] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:42.501341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:42.510741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:42.536740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdfe2f-08d3-4cce-8c74-e196270ca978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.537376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfe2f-08d3-4cce-8c74-e196270ca978 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.537651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfe2f-08d3-4cce-8c74-e196270ca978 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.537915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfe2f-08d3-4cce-8c74-e196270ca978 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.538567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdfe2f-08d3-4cce-8c74-e196270ca978 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.540004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdfe2f-08d3-4cce-8c74-e196270ca978 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.563973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 231/472] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:42 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:42.565321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a55d-0f70-4144-a228-6530ceb4c457 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.565608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a55d-0f70-4144-a228-6530ceb4c457 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.565881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13a55d-0f70-4144-a228-6530ceb4c457 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.569338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 232/473] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:42.570155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:42.571471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a55d-0f70-4144-a228-6530ceb4c457 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:42.624633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431a304-33a8-4175-bfe9-09333e3d005e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.680896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf39c7-2a6a-42c7-8a00-2e49dfc35744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.681669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf39c7-2a6a-42c7-8a00-2e49dfc35744 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.681963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf39c7-2a6a-42c7-8a00-2e49dfc35744 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.682288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf39c7-2a6a-42c7-8a00-2e49dfc35744 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.682957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf39c7-2a6a-42c7-8a00-2e49dfc35744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:42.683266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf39c7-2a6a-42c7-8a00-2e49dfc35744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.684699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf39c7-2a6a-42c7-8a00-2e49dfc35744 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.704792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 242/474] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:42.706441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e062c7-6666-4016-bd20-fc6cd43af241 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.706851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e062c7-6666-4016-bd20-fc6cd43af241 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.708069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e062c7-6666-4016-bd20-fc6cd43af241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.716418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13a55d-0f70-4144-a228-6530ceb4c457 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.735911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-23e062c7-6666-4016-bd20-fc6cd43af241 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:42.737584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-23e062c7-6666-4016-bd20-fc6cd43af241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:42.769230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.769906 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.770623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.770898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.771704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.773472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:42.799745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 233/475] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:42 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:42.801448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:42.823639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 243/476] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:42.849582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:42.933213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e18543-385f-43c9-81fc-068b416355fb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:42.971836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:42.972808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:42.973301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:42.973753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:42.974846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:42.976643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:43.001533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 234/477] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:42 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:43.123204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e062c7-6666-4016-bd20-fc6cd43af241 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:43.182646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:43.241481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e062c7-6666-4016-bd20-fc6cd43af241 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:43.279110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:43.279717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:43.279990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:43.280259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:43.280940 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:43.282336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:43.291685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.sql.core [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:42:43.291685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:42:43.291685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [parameters: {'id': 'cfeeec61cafa49b687264908f2d4b099', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:42:43.291685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Sep 19 11:42:43.308934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:42:43.309863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application yield resource Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise self.value Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application session.commit() Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:42:43.310879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:42:43.311808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:42:43.313640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:42:43.315563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [parameters: {'id': 'cfeeec61cafa49b687264908f2d4b099', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:43.320219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:42:43.322443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:43.325405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 244/478] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Sep 19 11:42:43 2022] POST /identity/v3/roles => generated 144 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:43.325511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:43.415650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:43.432589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb3f7-8ebf-4ac5-b7bc-8b589e2c4c70 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:43.468695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e90f4-93a8-40dc-808f-8b2efbe6a3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:43.469360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e90f4-93a8-40dc-808f-8b2efbe6a3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:43.469639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e90f4-93a8-40dc-808f-8b2efbe6a3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:43.469910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e90f4-93a8-40dc-808f-8b2efbe6a3e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:43.480991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e90f4-93a8-40dc-808f-8b2efbe6a3e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-355e90f4-93a8-40dc-808f-8b2efbe6a3e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:43.486484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:43.487354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:43.488699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 235/479] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:42:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:43.499551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:43.633222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a2e18-f1a6-436b-884f-c6d4bdfdfcdf None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:43.645036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:43.678270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589ab81-7e1b-4b35-9e91-befae895376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:43.678888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589ab81-7e1b-4b35-9e91-befae895376b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:43.679164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589ab81-7e1b-4b35-9e91-befae895376b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:43.679431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589ab81-7e1b-4b35-9e91-befae895376b None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:43.680099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589ab81-7e1b-4b35-9e91-befae895376b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:43.680397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589ab81-7e1b-4b35-9e91-befae895376b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:43.681792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589ab81-7e1b-4b35-9e91-befae895376b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:43.691221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 245/480] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:44.842421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523fdd6-1593-4a8c-8500-acb73a862f12 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:44.842924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523fdd6-1593-4a8c-8500-acb73a862f12 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:44.842924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523fdd6-1593-4a8c-8500-acb73a862f12 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:44.844549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 236/481] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:44.850408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464a785-2338-4c3d-b884-32e8aa408300 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:44.850793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464a785-2338-4c3d-b884-32e8aa408300 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:44.851007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464a785-2338-4c3d-b884-32e8aa408300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:44.884910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b464a785-2338-4c3d-b884-32e8aa408300 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:44.886123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b464a785-2338-4c3d-b884-32e8aa408300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:44.974914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 246/482] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:45.305074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523fdd6-1593-4a8c-8500-acb73a862f12 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:45.443007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523fdd6-1593-4a8c-8500-acb73a862f12 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:45.489425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c60834-6248-49f5-a040-45cbff722028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:45.490525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c60834-6248-49f5-a040-45cbff722028 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:45.491004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c60834-6248-49f5-a040-45cbff722028 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:45.491475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c60834-6248-49f5-a040-45cbff722028 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:45.506683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c60834-6248-49f5-a040-45cbff722028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f4c60834-6248-49f5-a040-45cbff722028 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:45.511914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:45.512794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:45.513615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:45.516146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 237/483] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:45.522942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464a785-2338-4c3d-b884-32e8aa408300 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:45.532315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba95f-d1f9-4a40-aa68-e0a7810ef968 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:45.532863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba95f-d1f9-4a40-aa68-e0a7810ef968 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:45.533367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba95f-d1f9-4a40-aa68-e0a7810ef968 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:45.535397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 238/484] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:45.542552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41706-ff07-4b7b-99cb-a7abe71637c3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:45.543070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41706-ff07-4b7b-99cb-a7abe71637c3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:45.543630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41706-ff07-4b7b-99cb-a7abe71637c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:45.562107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:45.570372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-50c41706-ff07-4b7b-99cb-a7abe71637c3 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:45.573872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-50c41706-ff07-4b7b-99cb-a7abe71637c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:45.691834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464a785-2338-4c3d-b884-32e8aa408300 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:45.694364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:45.706406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 239/485] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:45.748864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:45.749494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:45.749770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:45.750036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:45.750695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:45.750991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:45.752459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:45.766081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 247/486] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:45.772784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41706-ff07-4b7b-99cb-a7abe71637c3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:45.928118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41706-ff07-4b7b-99cb-a7abe71637c3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:45.983322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:45.984226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:45.984648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:45.985059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:45.988671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:45.998325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:45.999821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:46.033558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:46.035875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:46.038548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:46.038548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:46.038548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:46.039169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.039890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 240/487] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:46.046143 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.193968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6529d-7721-4c70-8683-b519da83958c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.208378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dd64a-4daa-4f4e-bc21-a6406da6dc83 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.232835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3da267-faaf-4391-a5b2-d8e6c7cf0be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.233520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3da267-faaf-4391-a5b2-d8e6c7cf0be2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.233962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3da267-faaf-4391-a5b2-d8e6c7cf0be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.234246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3da267-faaf-4391-a5b2-d8e6c7cf0be2 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.234942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3da267-faaf-4391-a5b2-d8e6c7cf0be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:46.235244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3da267-faaf-4391-a5b2-d8e6c7cf0be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:46.236756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3da267-faaf-4391-a5b2-d8e6c7cf0be2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:46.250899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 241/488] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:46.252123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128a41c-d40e-460c-b6d8-5a4734e50571 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.252406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128a41c-d40e-460c-b6d8-5a4734e50571 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.252677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128a41c-d40e-460c-b6d8-5a4734e50571 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.256526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413cd79-9510-4ee1-bb19-59dc215bf4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.257341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cd79-9510-4ee1-bb19-59dc215bf4db None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.257692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cd79-9510-4ee1-bb19-59dc215bf4db None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.258039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cd79-9510-4ee1-bb19-59dc215bf4db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.258871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 242/489] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:46.259740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128a41c-d40e-460c-b6d8-5a4734e50571 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.271819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413cd79-9510-4ee1-bb19-59dc215bf4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6413cd79-9510-4ee1-bb19-59dc215bf4db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:46.278947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:46.280000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:46.280892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 248/490] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:46.281728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bad886-b62f-46a8-84f5-9f50fdcf6ae8 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.281728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bad886-b62f-46a8-84f5-9f50fdcf6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.281728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bad886-b62f-46a8-84f5-9f50fdcf6ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.307727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f1bad886-b62f-46a8-84f5-9f50fdcf6ae8 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:46.310085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f1bad886-b62f-46a8-84f5-9f50fdcf6ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:46.329183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:46.333338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:46.388602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 249/491] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:46.389062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128a41c-d40e-460c-b6d8-5a4734e50571 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.389493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bad886-b62f-46a8-84f5-9f50fdcf6ae8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.432485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4dcf-f347-4108-847d-a5d0dbf8c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.433106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4dcf-f347-4108-847d-a5d0dbf8c474 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.433400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4dcf-f347-4108-847d-a5d0dbf8c474 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.433666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4dcf-f347-4108-847d-a5d0dbf8c474 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.443505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd4dcf-f347-4108-847d-a5d0dbf8c474 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:46.445009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd4dcf-f347-4108-847d-a5d0dbf8c474 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6bbd4dcf-f347-4108-847d-a5d0dbf8c474 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:46.458819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:46.459746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:46.460649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 243/492] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:46.461871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7b425-8adc-461f-b92f-2c5b41b0b3eb None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.461871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7b425-8adc-461f-b92f-2c5b41b0b3eb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.462019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7b425-8adc-461f-b92f-2c5b41b0b3eb None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.463399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 244/493] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:46.468489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a429b-8037-47f6-9bdd-ba978dc811f4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.468765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a429b-8037-47f6-9bdd-ba978dc811f4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.469037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a429b-8037-47f6-9bdd-ba978dc811f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.488751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-036a429b-8037-47f6-9bdd-ba978dc811f4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:46.490046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-036a429b-8037-47f6-9bdd-ba978dc811f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:46.534044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bad886-b62f-46a8-84f5-9f50fdcf6ae8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.575846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.576849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.577399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.577884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.578797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:46.579310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:46.580913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:46.582155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 245/494] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:46.583655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a429b-8037-47f6-9bdd-ba978dc811f4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.593516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 250/495] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:46.601282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.623886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:46.683465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:46.730155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa149b0-0577-40b7-8d60-cca75aae83ed None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.746795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a429b-8037-47f6-9bdd-ba978dc811f4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.765888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.766520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.766799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.767068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.778699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:46.780132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:46.782186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f553b-08d1-44b3-9f31-cf930fa698af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.782789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f553b-08d1-44b3-9f31-cf930fa698af None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.783065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f553b-08d1-44b3-9f31-cf930fa698af None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.783336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f553b-08d1-44b3-9f31-cf930fa698af None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.784065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f553b-08d1-44b3-9f31-cf930fa698af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:46.784371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f553b-08d1-44b3-9f31-cf930fa698af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:46.786420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f553b-08d1-44b3-9f31-cf930fa698af None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:46.795367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:46.796289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:46.802055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:46.802055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:46.802055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:46.802055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 251/496] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:46.802055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.829064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 246/497] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:46.830537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9658e60-d589-472b-8283-7f26c715b12b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.830828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9658e60-d589-472b-8283-7f26c715b12b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.831154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9658e60-d589-472b-8283-7f26c715b12b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.833278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 247/498] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:46.837093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9658e60-d589-472b-8283-7f26c715b12b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.876874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:46.912972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611af27d-5e6e-497d-ade9-94a98f0d2428 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.935004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:46.942879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9658e60-d589-472b-8283-7f26c715b12b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:46.949007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.949675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.950305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.950305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.961004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:46.966216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:46.967098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:46.967931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 252/499] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:46.968588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:46.981134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498c93d-870d-4113-b544-7e2afb32ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:46.981459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c93d-870d-4113-b544-7e2afb32ba3b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.981740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c93d-870d-4113-b544-7e2afb32ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.982010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c93d-870d-4113-b544-7e2afb32ba3b None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:46.982649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498c93d-870d-4113-b544-7e2afb32ba3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:46.982949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498c93d-870d-4113-b544-7e2afb32ba3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:46.984320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498c93d-870d-4113-b544-7e2afb32ba3b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:46.995872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 248/500] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:46.996835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff346f-b5cf-4bd7-abf7-4e4f26394beb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:46.997117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff346f-b5cf-4bd7-abf7-4e4f26394beb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:46.997423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff346f-b5cf-4bd7-abf7-4e4f26394beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.014828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f2ff346f-b5cf-4bd7-abf7-4e4f26394beb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:47.016014 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f2ff346f-b5cf-4bd7-abf7-4e4f26394beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:47.072640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc68b60-0ac9-4f14-903b-d3e0429e98e3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.080210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 249/501] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:47.081019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff346f-b5cf-4bd7-abf7-4e4f26394beb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.099801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.108178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.108779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.109058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.109358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.177375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.191971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.193339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff346f-b5cf-4bd7-abf7-4e4f26394beb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.193575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.228453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.229078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.229421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.229691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.241382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:47.247522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:47.248398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:47.249229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:47.249926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 250/502] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:47.250540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.297828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 253/503] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:47.298879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.330536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.366203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb84e1-ea30-4a2f-bbbc-84660a25fc1b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.400292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.400887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.401238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.401457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.402121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:47.402421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.403783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.410392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee7b98-74a3-4063-a5e0-2af8282ce540 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.411508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 251/504] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:47.412278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.425017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.446964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.447584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.447856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.448123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.454989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.456420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:47.469402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:47.470414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 254/505] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:47.471311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.519868 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5add7-297d-4d43-96bd-ed0d25074f82 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.552657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.553287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.553564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.553831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.554483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:47.554778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.556144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.561443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.563857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 252/506] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:47.564636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.575350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dffba-44cb-49bd-aaf9-aaaa8570623a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.610226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.610850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.611125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.611395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.621957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.623870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.636310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:47.638422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:47.639271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:47.640100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:47.640100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.640100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:47.640100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 255/507] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:47.640712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.668387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed9e76-d0ef-4198-8ecc-0045b6bfcdde None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.701680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.702303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.702581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.702860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.713792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.715231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:47.729409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:47.730334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:47.731160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:47.731160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.731160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:47.731160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 253/508] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:47.731387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.748181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19553c2f-727e-4552-8bf1-c0115d2488c4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.781604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.782151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.782424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.782691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.791354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.793510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.795287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:47.809597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:47.810478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:47.811534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:47.811534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.811534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:47.811534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 256/509] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:47.811534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.830442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fbf1f-75c7-434a-a7b1-304a4d42b658 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.853130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:47.864976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.865705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.865978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.866270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.867005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:47.867301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.868710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.885779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 254/510] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:47.886568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.912202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bea1c-4c64-434e-b3b4-31fc2b06c511 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:47.945673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:47.946282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:47.946553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:47.946814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:47.957669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:47.959135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:47.972726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:47.974076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:47.974926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:47.974926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:47.974926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:47.974926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 257/511] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:47.974926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:47.985104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231d662-a1a4-4b0c-a558-7602a08012fd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.018843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.019443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.019713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.019987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.020621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:48.020915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.021727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.022513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.034091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 255/512] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:48.034840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.078047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.081186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9117f6d-c232-457f-ab2a-0d975d0d5da3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.115994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.116587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.116865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.117133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.117784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:48.118087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.119423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.131283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 258/513] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:48.132056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.141724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669910e-23a7-48d9-bdea-09180e5b78bc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.174275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.174871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.175151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.176044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.176831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:48.177127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.178546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.190695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 256/514] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:48.192350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.229172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0e970-2270-4e99-97fd-4ec2dc2d0274 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.231479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.263825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.264430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.264705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.264976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.288434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.291081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4adc83-7673-4195-b565-4f80ea099f72 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.325810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.326403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.326678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.326948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.327584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:48.327880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.329265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.331595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.333252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.340150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 257/515] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:48.340937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.435276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 259/516] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:48.436092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.440620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cd0cb-3957-4ea2-a130-7c73eb3b90dd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.441803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.475073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.475696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.475976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.476248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.482781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.484217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:48.495854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:48.496871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:48.497744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 258/517] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:48.498224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.522651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.542559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af753fd0-75f3-49bc-86b0-f6da7b139455 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.575447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.576038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.576319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.576585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.577257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.578684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.599686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cfe6a-f72e-45a5-8966-f9f378c01e04 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.600110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 260/518] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:42:48 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:42:48.600927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.650009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.650464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.650752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.651036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.664463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.665992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.673950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:48.678855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:48.680022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:48.681116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.729259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eea61d-b295-48f7-98ac-30a700fcdb6b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.768712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.769437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.769720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.769999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.779258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.780542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.786614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:48.792540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:48.793717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 261/520] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:48.794767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.815385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc235da-ba1c-42c9-82ad-bd332ef574a4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.853347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.854108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.854455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.854792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.866632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.868201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:48.883024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:48.883962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:48.885600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:48.885600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:48.885600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:48.885600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 260/521] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:48.885600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:48.914126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30479156-74e7-455f-8fe0-ce6cde626f33 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:48.936419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:48.952413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:48.953017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:48.953339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:48.953615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:48.954314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:48.954620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:48.956039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:48.979363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 262/522] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:48.979363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.003030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d6b9-e13f-4cdc-a710-f4a6ab65c24f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.034162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:49.040233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.040840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.041127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.041421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.042153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:49.042454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.043948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.062419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 261/523] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:49.063078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.092377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973baa-b1a8-4426-995d-e8de05c6efaa None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.130861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.131784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.132246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.132526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.133294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:49.133603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.135040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.171332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36a255-7b91-4ccd-822a-2deff4c27047 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.185291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 263/524] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Sep 19 11:42:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:49.185291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.213744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.214452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.214731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.215117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.215761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:49.216063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.217441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.226265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:49.231032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 262/525] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:49.231860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.288683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:49.295607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc177ad8-9b83-4dde-8f6d-e9e41c6c9298 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.333092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.333720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.334441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.334718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.335455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=84d136bca97e446a888c1b51a5b761a2) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:49.335761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.337190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.346079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa44cc-cd74-4452-913a-5c3a0c207286 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.349557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 264/526] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/role_assignments?user.id=84d136bca97e446a888c1b51a5b761a2&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:49.350436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.388132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.388963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.389623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.389773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.478483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.480500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.490797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833db30-440c-4ea7-aa1f-41adc28edcad None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.518190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:49.531099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.531872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.532148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.532411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.562337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:49.615676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.617216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.618920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 263/527] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:49.620695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.733504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 265/528] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:49.734392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.738336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:49.762672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8255967-97a5-46f0-a618-9cb9238c0583 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.801693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.802420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.802757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.803092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.810033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.811562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:49.824342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:49.825223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:49.826238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 264/529] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:49.827753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.848707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:49.860191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa63624-e0f7-44aa-b4ce-7f5effe3d782 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:49.906532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:49.907635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:49.908341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:49.908721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:49.923449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:49.925053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:49.945778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:49.946936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:49.947969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:49.947969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:49.947969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:49.954078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 266/530] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:49.954078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:49.959757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c3a67-9892-46a4-b3a0-7a80303a3381 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.003960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.004771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.005182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.005574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.019380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.021714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:50.021830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:50.043776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:50.044731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:50.046150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:50.046150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:50.046150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:50.046150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 265/531] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:50.046390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.077630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1986a-5e35-46db-871d-7f276e881529 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.117513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.119753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.120228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.120692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.121912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:50.122414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.124207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.127859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:50.145308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 267/532] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:50.146658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.178392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f6e6-b1fe-4609-8921-6a0810871d19 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.228218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.228852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.229131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.229474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.230130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:50.230478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.233050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.245857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 266/533] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:50.250249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.271321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476dad-51bc-4d1e-a00c-07546e22206d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.293403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:50.322184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.322793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.323073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.323349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.323993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:50.324297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.325845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.341667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 268/534] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:50.342554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.364053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f319b-09fb-48fd-8183-daec0f237be8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.389518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:50.404060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.404990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.405612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.406086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.407009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=f951f4e6a8e5407580ec1ead59fdeec9) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:50.407529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.409251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.421309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 267/535] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/role_assignments?user.id=f951f4e6a8e5407580ec1ead59fdeec9&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:50.422611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.472996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ac44-162b-433a-b4c1-5caef820607f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.522437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.523458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.524177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.525499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.542309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.544310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:50.570255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:50.571136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:50.571962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:50.581559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 269/536] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:50.586457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.646078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288068-5eb6-49d1-999c-5ebf1cd4ede7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.657034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:50.702045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.702678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.702956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.703228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.712349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.713869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:50.735253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:50.736134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:50.736946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 268/537] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:50.738019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23a2b-59e9-4c09-8d11-eaa864a5419c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.744445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.792503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.793115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.793425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.793697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.794400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:50.794707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.796134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.826771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 270/538] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:50.833408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:50.844642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:50.913968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bee51-66c1-4cdc-a65c-08094c19d427 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.948337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b25d-14fe-420b-bec7-2c4612477c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:50.948936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b25d-14fe-420b-bec7-2c4612477c60 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.949247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b25d-14fe-420b-bec7-2c4612477c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.949517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b25d-14fe-420b-bec7-2c4612477c60 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.950204 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b25d-14fe-420b-bec7-2c4612477c60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:50.950500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b25d-14fe-420b-bec7-2c4612477c60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:50.951931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b25d-14fe-420b-bec7-2c4612477c60 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:50.970484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b4f4e-1077-46b5-a278-8a59cd7d772e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:50.970654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 269/539] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:50.971864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae2e3-4648-43fc-9dde-471623f5e729 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:50.972199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae2e3-4648-43fc-9dde-471623f5e729 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:50.972568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae2e3-4648-43fc-9dde-471623f5e729 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:50.973078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:50.979224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 270/540] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:50.980075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ae2e3-4648-43fc-9dde-471623f5e729 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:51.013803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b1a4-cdc1-41e6-8bd8-47f575b5a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:51.014520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b1a4-cdc1-41e6-8bd8-47f575b5a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:51.014900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b1a4-cdc1-41e6-8bd8-47f575b5a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:51.015288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b1a4-cdc1-41e6-8bd8-47f575b5a0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:51.016028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b1a4-cdc1-41e6-8bd8-47f575b5a0d9 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=d84265ba2619438485db9a18f94c87aa) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:51.016505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b1a4-cdc1-41e6-8bd8-47f575b5a0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:51.019119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b1a4-cdc1-41e6-8bd8-47f575b5a0d9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:51.027222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 271/541] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/role_assignments?user.id=d84265ba2619438485db9a18f94c87aa&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:51.028495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8979aa-40f9-49c4-859c-e571857adf4a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:51.028775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8979aa-40f9-49c4-859c-e571857adf4a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:51.029044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8979aa-40f9-49c4-859c-e571857adf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:51.062412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2e8979aa-40f9-49c4-859c-e571857adf4a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:51.062412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2e8979aa-40f9-49c4-859c-e571857adf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:51.178371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ae2e3-4648-43fc-9dde-471623f5e729 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:51.187526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:51.215977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 272/542] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:51.228827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:51.229457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:51.229772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:51.230048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:51.230827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=a82e9cce21e2452ca7977b828a137c13) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:51.231130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:51.232607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:51.239791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 271/543] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:50 2022] GET /identity/v3/role_assignments?user.id=a82e9cce21e2452ca7977b828a137c13&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:51.551300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8979aa-40f9-49c4-859c-e571857adf4a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:51.661546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:51.667967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8979aa-40f9-49c4-859c-e571857adf4a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:51.727255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883075-190f-4e08-873d-0db4ce7b04a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:51.728237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883075-190f-4e08-873d-0db4ce7b04a4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:51.728748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883075-190f-4e08-873d-0db4ce7b04a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:51.729234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883075-190f-4e08-873d-0db4ce7b04a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:51.749009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883075-190f-4e08-873d-0db4ce7b04a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0e883075-190f-4e08-873d-0db4ce7b04a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:51.754207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:51.755097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:51.755893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:51.758565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 273/544] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:51.766453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:51.773187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2351ad3-6381-4935-ba3d-733a1a1b8b16 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:51.773717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2351ad3-6381-4935-ba3d-733a1a1b8b16 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:51.774188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2351ad3-6381-4935-ba3d-733a1a1b8b16 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:51.775943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 274/545] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:51.789623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f10f-060c-4d00-9c68-ce510d70f061 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:51.790137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f10f-060c-4d00-9c68-ce510d70f061 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:51.790603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f10f-060c-4d00-9c68-ce510d70f061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:51.819160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-87b1f10f-060c-4d00-9c68-ce510d70f061 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:51.821877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-87b1f10f-060c-4d00-9c68-ce510d70f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:51.902066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 275/546] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:51.984441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aad0a-c8b4-44cc-8bc3-5dad462179bc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:52.035899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:52.036520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:52.036797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:52.037065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:52.037895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:52.038197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:52.039553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:52.053409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 272/547] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:52.058688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1f10f-060c-4d00-9c68-ce510d70f061 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:52.153572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:52.176212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1f10f-060c-4d00-9c68-ce510d70f061 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:52.211594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:52.212224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:52.212503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:52.212773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:52.223658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:52.225395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:52.239785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:52.240679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:52.241553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:52.241553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:52.241553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:52.241553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 276/548] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:52.246390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:52.263611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:52.284595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:52.412756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deebcf-30b0-4916-8e56-dba938890ae6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:52.450802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70375d55-64ae-457f-8b81-76f115042627 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:52.468575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:52.469211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:52.469497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:52.469768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:52.470423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:52.470731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:52.472263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:52.483681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:52.496400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 273/549] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:52.497310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:52.498157 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:52.498637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:52.499101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:52.500613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:52.521531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:52.527370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:52.528834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:52.529748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 277/550] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:52.544407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:52.698572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:52.712688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09d5a-6dad-4b91-9636-c188119f8e0c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:52.747915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c973cea-fa01-4080-aa59-d5eab6656c23 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:52.775841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:52.776473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:52.776994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:52.777341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:52.786012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:52.787470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:52.811756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:52.812706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:52.814585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 274/551] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:42:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:52.821883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:52.822181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:52.822497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:52.822758 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:52.823026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:52.823698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:52.823996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:52.825399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:52.836154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 278/552] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:52.843618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:52.903006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:52.956264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31237-4f95-4eec-b2d1-0a99c9ff80a8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:52.996345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:52.996983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:52.997289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:52.997563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.008835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:53.010342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:53.025093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:53.026119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:53.027351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:53.027351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:53.027351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:53.027351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 279/553] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:53.035308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:53.043976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9b1d2-f200-40bf-9ad2-51a4d4028643 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.109654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6045ae9-430a-406b-94c0-4feace549ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:53.110309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045ae9-430a-406b-94c0-4feace549ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.110592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045ae9-430a-406b-94c0-4feace549ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.110862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045ae9-430a-406b-94c0-4feace549ab4 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.111595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6045ae9-430a-406b-94c0-4feace549ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:53.111892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6045ae9-430a-406b-94c0-4feace549ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:53.114302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6045ae9-430a-406b-94c0-4feace549ab4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:53.137265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 275/554] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Sep 19 11:42:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:53.138577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8e07-a552-4ec9-a2b1-f69d8fe09bac None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.138861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8e07-a552-4ec9-a2b1-f69d8fe09bac None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.139131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8e07-a552-4ec9-a2b1-f69d8fe09bac None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.140655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 276/555] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:53.141379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8e07-a552-4ec9-a2b1-f69d8fe09bac None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:53.157520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:53.174804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e653d39-fb88-44c6-bfcd-be0bd28813cd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.178848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:53.222670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2503f-8a10-4d67-a53e-5df20310c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:53.223381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2503f-8a10-4d67-a53e-5df20310c233 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.223681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2503f-8a10-4d67-a53e-5df20310c233 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.224480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2503f-8a10-4d67-a53e-5df20310c233 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.224827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2503f-8a10-4d67-a53e-5df20310c233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:53.225129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2503f-8a10-4d67-a53e-5df20310c233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:53.226556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2503f-8a10-4d67-a53e-5df20310c233 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:53.246572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 280/556] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:53.246572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c781c7-4a5e-4c0b-b733-2f8811a4d960 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.246572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c781c7-4a5e-4c0b-b733-2f8811a4d960 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.246572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c781c7-4a5e-4c0b-b733-2f8811a4d960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.264715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-87c781c7-4a5e-4c0b-b733-2f8811a4d960 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:53.266675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-87c781c7-4a5e-4c0b-b733-2f8811a4d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:53.275926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8e07-a552-4ec9-a2b1-f69d8fe09bac None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.311445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11ae2f-58e7-4dc0-bd90-553057be9118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:53.312338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ae2f-58e7-4dc0-bd90-553057be9118 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.312886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ae2f-58e7-4dc0-bd90-553057be9118 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.313359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ae2f-58e7-4dc0-bd90-553057be9118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.349662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 281/557] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:53.350605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c781c7-4a5e-4c0b-b733-2f8811a4d960 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:53.421248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11ae2f-58e7-4dc0-bd90-553057be9118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:53.422914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11ae2f-58e7-4dc0-bd90-553057be9118 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:53.446168 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:53.458676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:53.466696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c781c7-4a5e-4c0b-b733-2f8811a4d960 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.540037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:53.540613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.540850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.541116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.557668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:53.559112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:53.579552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:53.580585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:53.581788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 282/558] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:42:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:53.586653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:53.628849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 277/559] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:53.630217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe38d-ca10-439d-b1b4-97d830bbfac8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.630507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe38d-ca10-439d-b1b4-97d830bbfac8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.630776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe38d-ca10-439d-b1b4-97d830bbfac8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.636796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 278/560] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:53.637614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe38d-ca10-439d-b1b4-97d830bbfac8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:53.719464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab275d-c235-42d9-8084-bffba25a550b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.757324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad961596-f010-4585-8fa8-916ef3d6c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:53.757951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad961596-f010-4585-8fa8-916ef3d6c5ea None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.758235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad961596-f010-4585-8fa8-916ef3d6c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.758509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad961596-f010-4585-8fa8-916ef3d6c5ea None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.759261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad961596-f010-4585-8fa8-916ef3d6c5ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:53.759569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad961596-f010-4585-8fa8-916ef3d6c5ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:53.761048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad961596-f010-4585-8fa8-916ef3d6c5ea None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:53.767577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe38d-ca10-439d-b1b4-97d830bbfac8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.780168 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:53.785762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 283/561] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:42:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:53.787202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f539c1-ef41-4142-9080-c9c3e6ec3186 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.787489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f539c1-ef41-4142-9080-c9c3e6ec3186 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.787761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f539c1-ef41-4142-9080-c9c3e6ec3186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.806359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-51f539c1-ef41-4142-9080-c9c3e6ec3186 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:53.807266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:53.807542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-51f539c1-ef41-4142-9080-c9c3e6ec3186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:53.807895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.808169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.808438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:53.815072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:53.821672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:53.823135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:53.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:53.839471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:53.840330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:53.840330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:53.840330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:53.840330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 279/562] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:53.841203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:53.885144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 284/563] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:53.886004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f539c1-ef41-4142-9080-c9c3e6ec3186 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:53.951580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2870-787e-4b72-81b6-45ab61b2d8d8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.989540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:53.989721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f539c1-ef41-4142-9080-c9c3e6ec3186 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:53.990167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:53.990444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:53.990711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.001292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:54.007416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:54.008341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 280/564] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:54.009935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.030771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493134-f132-4d53-a64e-0e46b742a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.031403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493134-f132-4d53-a64e-0e46b742a514 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.031675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493134-f132-4d53-a64e-0e46b742a514 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.031945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493134-f132-4d53-a64e-0e46b742a514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.034127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.042476 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493134-f132-4d53-a64e-0e46b742a514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.043918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493134-f132-4d53-a64e-0e46b742a514 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.045681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0a493134-f132-4d53-a64e-0e46b742a514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:54.060081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:54.061009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 285/565] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bf973-9b79-4a51-992e-d733b813f255 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bf973-9b79-4a51-992e-d733b813f255 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bf973-9b79-4a51-992e-d733b813f255 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 286/566] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:54.067597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bf973-9b79-4a51-992e-d733b813f255 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.123284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfaa26-a49f-4732-8495-319847020de6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.160086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.160776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.161058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.161365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.162012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:54.162312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.163682 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.175824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 281/567] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:54.175824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.180205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bf973-9b79-4a51-992e-d733b813f255 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.213673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a97cb-f128-43c9-bfa8-f79da992eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.214864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a97cb-f128-43c9-bfa8-f79da992eaee None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.215137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a97cb-f128-43c9-bfa8-f79da992eaee None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.215402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a97cb-f128-43c9-bfa8-f79da992eaee None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.216061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a97cb-f128-43c9-bfa8-f79da992eaee None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:54.216356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a97cb-f128-43c9-bfa8-f79da992eaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.217727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a97cb-f128-43c9-bfa8-f79da992eaee None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.226677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 287/568] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:54.227800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e39876-e792-4fc2-9855-16305462c6c4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.228073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e39876-e792-4fc2-9855-16305462c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.228338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e39876-e792-4fc2-9855-16305462c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.246835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-37e39876-e792-4fc2-9855-16305462c6c4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:54.247999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-37e39876-e792-4fc2-9855-16305462c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:54.264356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.282914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6624-c29f-4246-95ca-9865f3911667 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.299331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.317340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 288/569] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:54.321196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.321373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e39876-e792-4fc2-9855-16305462c6c4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.321471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.321471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.321471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.321471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:54.321471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.321471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.332786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 282/570] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:54.333621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.427937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e39876-e792-4fc2-9855-16305462c6c4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.444824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72860c30-7f51-422f-88e3-38b5cdcd25c5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.465747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.466371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.466647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.466915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.477380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:54.481408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:54.482072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:54.483159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 289/571] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:54.484101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.485282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.485752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.486194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.494498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.495978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:54.508677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:54.509579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:54.510482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 283/572] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:54.510957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.513836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.543701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.601604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b29576-6548-4736-81b3-3514fc6e9f3c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.620478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd7754-ce59-4719-8170-5900e00e5465 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.635142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.635760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.636035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.636301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.646480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.647915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.658696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.659319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.660168 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.660437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:54.664008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:54.665009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:54.665929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:54.665929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:54.665929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:54.665929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 290/573] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:54.665929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.667462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.668936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:54.680700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:54.681757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:54.682660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 284/574] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:54.683140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.746244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.767401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.772566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdd52b-d261-4842-95dd-a440fe73c43d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.784256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aeb740-16c5-43e0-973e-c37d35e36fe3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.807210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.807806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.808082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.808354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.809015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:54.809351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.810702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.816928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.817543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.817826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.818098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.823079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 291/575] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:54.823234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:54.823234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.823416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.823503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.832975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 285/576] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:54.833703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.923884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f67f45-4961-47c1-b4f4-a2bc92ef7966 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.933403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b09e-63b3-4590-9f65-36de0c9afe58 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:54.956838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:54.958032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.958655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.958962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.959287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.969945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:54.971245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:54.971838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:54.972712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:54.972976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:54.973647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:54.974295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:54.975643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:54.977279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:54.978154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:54.979007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 292/577] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:54.979697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:54.992387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 286/578] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:54.992387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.002124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.079788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b4e9-58b0-4c9d-8d1c-50088ab088db None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.086468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1d99-0530-463e-b456-8cc576b75935 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.113538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.114135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.114413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.114679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.115365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:55.115669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.117082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.118672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.119296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.119576 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.119854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.129924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 293/579] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:55.130804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.130938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.132327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:55.149710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:55.150851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:55.151909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:55.151909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:55.151909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:55.151909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 287/580] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:55.152140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.184823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.215790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.237892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fd36c-5f52-4b28-9e70-29facbd100bd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.252528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772eede2-a6f2-40f9-8106-18f19f1a36f3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.277753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.278356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.278639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.278906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.279632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=982dd41852574cd0a7db4184da3141ef) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:55.279938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.281377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.286296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.286749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 294/581] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/role_assignments?user.id=982dd41852574cd0a7db4184da3141ef&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:55.286948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.287173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.287444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.287538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.288108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:55.288414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.289818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.305935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 288/582] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:55.306865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.411845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea6051-9a97-4d2b-835c-06870b2b7ae2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.412550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.419967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d29f-f874-4707-97b4-f0df82adeeb4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.450567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.451123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.451404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.451678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.457085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.457781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.458058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.458333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/84d136bca97e446a888c1b51a5b761a2/roles/e1851a550fc04d8fb28a3fbaafed04de` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.461190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.462476 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.475291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=84d136bca97e446a888c1b51a5b761a2, role_id=e1851a550fc04d8fb28a3fbaafed04de)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:55.475670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:55.476577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:42:55.477906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:55.478440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.478511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 295/583] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:55.478511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.495405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 289/584] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:55 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/84d136bca97e446a888c1b51a5b761a2/roles/e1851a550fc04d8fb28a3fbaafed04de => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:55.496518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.497530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.626314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315fdd-b3cd-4d24-aba2-78f90ad85b3c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.629616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045fea-9919-4a52-8322-3e7fea44c805 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.673475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.674211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.674553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.674885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.675762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.676243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:55.676698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.676993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.677501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.677913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.678351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.689829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.692320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.694215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 296/585] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:55.694971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.702624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:55.714368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:55.715545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:55.716578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:55.716578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:55.716578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:55.717888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 290/586] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:55.718518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.778724 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.819611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d3df-67f9-44dd-bfba-4011eae0c3ea None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.840047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47d873-5226-4d98-8072-5113ef71087c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:55.856452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.857399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.857879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.858408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.859358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:55.859863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.861493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.877462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:55.878113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:55.878560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:55.878835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:55.881994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 297/587] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:55.883129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.887838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:55.888844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:55.901360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:55.902323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 291/588] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:55.903815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:55.967608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:55.993102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6bebc-4160-4a7a-ad7f-6c725437719b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.015729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d761c-3b16-49f5-85e1-83eb2fba1625 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.020144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:56.032497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.033168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.033554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.033920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.035222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:56.035618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.037270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.051842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 298/589] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:56.052950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.057258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.058058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.058494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.058899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.070746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.072417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:56.088544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:56.089656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:56.090529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:56.090529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:56.090529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:56.092677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 292/590] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:56.093685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.165113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb84c-31aa-4f7c-83b0-4d1b7703e5ff None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.202044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd6569-3c6c-4b03-b560-cdadd6100ade None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.202725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.203429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.203777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.204124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.205084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:56.205515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.208063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.216794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:56.232097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 299/591] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:56.233043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.243634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.244516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.244964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.245475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.254319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.256094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:56.268406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:56.269412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:42:56.270347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:56.272817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 293/592] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:56.273892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.280729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:56.345757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c5e3d-d50a-4faa-9d40-85b5c0692eca None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.382967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07f23-f066-447f-9692-b9a28f5aaaa5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.383813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.384425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.384750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.385028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.385740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:56.386153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.387749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.400147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 300/593] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:56.401109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.421006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.422055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.422548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.423034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.435272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.436968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:56.453010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:56.454045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:56.454916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:56.454916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:56.454916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:56.457410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 294/594] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:56.458603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.485895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:56.516223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:56.520390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6fc5d-8a8a-46ed-998f-14b72e0aa9da None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.558793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.559342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.559620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.559890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.560778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:56.561082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.562651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.570477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efccccf-d4d0-4ce2-9e71-3ba1320465b2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.584423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 301/595] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:56.585489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.610328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.610962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.611374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.611668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.621853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.623357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:56.642772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:56.643677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:56.645140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 295/596] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:56.646111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.708594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf0a5d-5f80-47cb-a86b-bdaf25bc382a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.747963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:56.750610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.752560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.753900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.754322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.755109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:56.755577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.757653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.771234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d84c8-4ebe-4a6a-a68f-57bf337b9a1a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.772064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 302/597] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:56.773531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.795401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:56.814330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.815376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.816610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.817083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.829314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.831077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:56.847450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:56.848499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:56.850036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:56.850036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:56.850036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:56.856365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 296/598] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:56.857480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.883796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f3986-68bd-4bbc-b65a-0de80ffb150a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:56.920857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:56.921481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:56.921756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:56.922023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:56.922813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:56.923116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:56.924647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:56.943425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 303/599] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:56.943425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:56.978901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10befb2a-300b-4b38-b92c-22bd81a7710d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:57.030804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:57.032098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:57.032628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.034005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.034519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.038962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:57.048177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:57.051229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:57.056388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22ec6-7e92-44a4-af82-111345567bfe None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:57.066161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:57.067039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:57.067907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:57.070776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 297/600] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:57.071743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:57.106846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:57.107450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.107727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.107999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.108638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:57.108940 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:57.110496 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:57.128237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 304/601] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:57.128237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:57.201681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cb81a-15ff-438c-8aef-3f3ec49124bb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:57.241707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:57.242756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.243728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.244222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/f951f4e6a8e5407580ec1ead59fdeec9/roles/e1851a550fc04d8fb28a3fbaafed04de` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.264307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=f951f4e6a8e5407580ec1ead59fdeec9, role_id=e1851a550fc04d8fb28a3fbaafed04de)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:57.266915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:57.276363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5499b83-f120-4a23-8dd9-d95d14c84b06 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:57.291326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 298/602] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:57 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/f951f4e6a8e5407580ec1ead59fdeec9/roles/e1851a550fc04d8fb28a3fbaafed04de => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:57.291326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:57.343225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:57.343923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.344106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.344375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.346537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:57.347364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:57.348815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:57.361849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:57.377438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 305/603] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:57.386810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:57.387681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:57.499506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02a7a-d336-40cd-90ac-6ea1a6fe6c3e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:57.566581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416c06-37b2-425a-ad64-93a4eaaf61ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:57.567731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416c06-37b2-425a-ad64-93a4eaaf61ad None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.568560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416c06-37b2-425a-ad64-93a4eaaf61ad None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.568560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416c06-37b2-425a-ad64-93a4eaaf61ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.576355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79416c06-37b2-425a-ad64-93a4eaaf61ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:57.577858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79416c06-37b2-425a-ad64-93a4eaaf61ad None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:57.579090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b9d7-ad4f-4d01-a0df-da1d9289a649 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-79416c06-37b2-425a-ad64-93a4eaaf61ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:42:57.591995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:57.592977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:57.593979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 299/604] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:57.595008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00946c47-8037-4086-a42b-183a7ca82105 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.595008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00946c47-8037-4086-a42b-183a7ca82105 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.595175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00946c47-8037-4086-a42b-183a7ca82105 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.596737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 300/605] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:42:57.603502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e0c4-f182-4eda-a03d-8af6fe513a78 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.603639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e0c4-f182-4eda-a03d-8af6fe513a78 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.603890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e0c4-f182-4eda-a03d-8af6fe513a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.623234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b7e7e0c4-f182-4eda-a03d-8af6fe513a78 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:57.624420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b7e7e0c4-f182-4eda-a03d-8af6fe513a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:57.630019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:57.630681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.630959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.631233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/d84265ba2619438485db9a18f94c87aa/roles/e1851a550fc04d8fb28a3fbaafed04de` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.648722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=d84265ba2619438485db9a18f94c87aa, role_id=e1851a550fc04d8fb28a3fbaafed04de)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:57.650231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:57.673078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 306/606] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:57 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/d84265ba2619438485db9a18f94c87aa/roles/e1851a550fc04d8fb28a3fbaafed04de => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:42:57.674296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:57.721177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 301/607] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:57.750960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:57.806177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84e35-470a-4098-ae95-bb67c63b1411 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.806524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84e35-470a-4098-ae95-bb67c63b1411 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.806725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84e35-470a-4098-ae95-bb67c63b1411 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.808293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 302/608] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:42:57.813382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63041c-4c94-4cff-825b-8a68d0e3f296 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.813902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63041c-4c94-4cff-825b-8a68d0e3f296 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.814353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63041c-4c94-4cff-825b-8a68d0e3f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.825197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2241-bb58-4225-8498-d7b2b9391880 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:57.837424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-de63041c-4c94-4cff-825b-8a68d0e3f296 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:42:57.838648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-de63041c-4c94-4cff-825b-8a68d0e3f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:42:57.873391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:57.893210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:57.894352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:57.894683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:57.895139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:57.896006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:57.896310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:57.905988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:57.924410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 303/609] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:42:57.931339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 307/610] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:57.937293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63041c-4c94-4cff-825b-8a68d0e3f296 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.058772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.067897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63041c-4c94-4cff-825b-8a68d0e3f296 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:58.107302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:58.108045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:58.108418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:58.108806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/a82e9cce21e2452ca7977b828a137c13/roles/e1851a550fc04d8fb28a3fbaafed04de` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:58.126864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=a82e9cce21e2452ca7977b828a137c13, role_id=e1851a550fc04d8fb28a3fbaafed04de)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:58.129273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:58.152999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 304/611] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:42:57 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/a82e9cce21e2452ca7977b828a137c13/roles/e1851a550fc04d8fb28a3fbaafed04de => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:42:58.176736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da39cd-c010-4ef1-9a77-c5eb70a5bfec None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:58.187564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:58.216100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:58.217002 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:58.217465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:58.217888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:58.229734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:58.235429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:58.236606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:58.237668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:58.240139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 308/612] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:58.250396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.278600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:58.291262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.410154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573405a-0e50-4083-b704-a19cfc0efe81 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:58.462306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:58.463100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:58.463478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:58.463851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:58.464643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:58.465186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:58.466918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:58.473360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685d09e-2802-476b-beec-db8e5a220e20 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:58.478877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 305/613] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:58.487249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.522624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:58.523190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:58.523471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:58.523740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:58.535403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:42:58.540770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:58.541700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:58.542525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 309/614] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:42:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:58.550923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.589402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:58.617648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65be35-9442-48fb-969c-cf36521b48b1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:58.630302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:58.671789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:58.672356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:58.672626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:58.672893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:58.690817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:58.692339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:58.726077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:58.727244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:58.728125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:58.728125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:58.728125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:58.733419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 306/615] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:58.744188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.768551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b4387-595e-48ae-baa4-5d3e2e87f0f5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:58.813519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:58.814128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:58.814393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:58.814659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:58.815324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:58.816169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:58.817606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:58.837303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 310/616] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:42:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:58.844312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:58.960977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:58.975698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dec4d2-e1e9-4738-8f64-5ad45afa2469 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:59.020366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:59.021315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:59.021315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:59.021818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:59.040314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e9de9-df40-40a8-a778-e759702b0803 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:59.053259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:59.054716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:59.077434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:59.078422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:59.080239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:59.080239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:59.080239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:59.080239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 311/617] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:59.085139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:59.104610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:59.123756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:59.124609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:59.125027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:59.125492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:59.126276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:59.126732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:59.128752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:59.158571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 307/618] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:59.182233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:59.235594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dae580-9a3b-4471-84a5-b22993773eb6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:59.287582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:59.288189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:59.288468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:59.288733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:59.289410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:59.289711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:59.291079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:59.323667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 312/619] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:42:59.329386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:59.336652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:59.428907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f0a14-485f-4b15-8ee9-ac0933f75fa1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:59.477779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:59.478426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:59.478704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:59.479075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:59.488696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:59.490139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:59.505105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:59.506840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:59.507981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 308/620] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:42:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:42:59.512284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:59.575697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:59.623125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f8f13-60cd-47f6-8c94-09e235bf4083 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:59.631172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4a3f-00d3-4edf-a5c8-e657a903a3f9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:59.670405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:59.671017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:59.671294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:59.671563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:59.672492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:42:59.672792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:59.674419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:59.698525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 309/621] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Sep 19 11:42:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:42:59.704646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:59.726920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:59.727845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:59.728283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:59.728717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:59.746559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:59.748303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:42:59.775761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:59.776917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:42:59.778008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:42:59.787649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 313/622] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:42:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:59.795126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:59.822029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7e11c-5e73-4957-b326-88e7e3e141ef None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:42:59.830462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:59.874362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:42:59.875388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:42:59.875734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:42:59.876166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:42:59.892679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:42:59.895025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:42:59.914305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:42:59.916566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:42:59.917600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:42:59.917600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:42:59.917600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:42:59.917600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 310/623] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:42:59.924364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:42:59.932804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:59.978961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5076148-eb3a-4d68-b81f-ff7e02cf353b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:00.024349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:00.024880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.025168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.025637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.026375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:00.026677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:00.028098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:00.083865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 314/624] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:42:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:00.089807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:00.147207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b640c-39a7-4b27-9905-a80ef9408f19 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:00.203060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a538-2b37-47d8-929a-7a49fa9c4156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:00.203981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a538-2b37-47d8-929a-7a49fa9c4156 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.204264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a538-2b37-47d8-929a-7a49fa9c4156 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.205019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a538-2b37-47d8-929a-7a49fa9c4156 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.205712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4a538-2b37-47d8-929a-7a49fa9c4156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:00.206401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4a538-2b37-47d8-929a-7a49fa9c4156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:00.207798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4a538-2b37-47d8-929a-7a49fa9c4156 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:00.222642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 311/625] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:00.224234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2c8bb-8d86-4449-a295-cd606684d2c3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.224489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2c8bb-8d86-4449-a295-cd606684d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.224740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2c8bb-8d86-4449-a295-cd606684d2c3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.226314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 312/626] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:00.228337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2c8bb-8d86-4449-a295-cd606684d2c3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:00.260433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c8c0-9a00-4f6b-ac4f-b001a5765dff None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:00.267199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:00.283022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:00.299014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344b76b-6c34-4c2f-8e29-066637134dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:00.299703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344b76b-6c34-4c2f-8e29-066637134dea None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.300673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344b76b-6c34-4c2f-8e29-066637134dea None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.300946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344b76b-6c34-4c2f-8e29-066637134dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.397542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344b76b-6c34-4c2f-8e29-066637134dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:00.399849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344b76b-6c34-4c2f-8e29-066637134dea None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:00.400959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2c8bb-8d86-4449-a295-cd606684d2c3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:00.439115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cfbf9-c549-4ede-b1bc-e9626eadfead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:00.441188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cfbf9-c549-4ede-b1bc-e9626eadfead None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.441729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cfbf9-c549-4ede-b1bc-e9626eadfead None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.442220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cfbf9-c549-4ede-b1bc-e9626eadfead None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.449393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cfbf9-c549-4ede-b1bc-e9626eadfead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:00.450874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cfbf9-c549-4ede-b1bc-e9626eadfead None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ca9cfbf9-c549-4ede-b1bc-e9626eadfead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:00.462473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:00.463373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:00.464347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 313/627] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:00.465376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c8b3-88b1-4c37-be22-170fb8a7e76f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.465376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c8b3-88b1-4c37-be22-170fb8a7e76f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.465557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0c8b3-88b1-4c37-be22-170fb8a7e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.485108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2ed0c8b3-88b1-4c37-be22-170fb8a7e76f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:00.486320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2ed0c8b3-88b1-4c37-be22-170fb8a7e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:00.529681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 315/628] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:00.529681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9223b33-1ef0-4a7a-96d8-e85ee5e191a8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.529681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9223b33-1ef0-4a7a-96d8-e85ee5e191a8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.529681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9223b33-1ef0-4a7a-96d8-e85ee5e191a8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.529681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 316/629] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:00.529681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9223b33-1ef0-4a7a-96d8-e85ee5e191a8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:00.552591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:00.556412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 314/630] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:00.557287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0c8b3-88b1-4c37-be22-170fb8a7e76f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:00.567993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:00.666291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0c8b3-88b1-4c37-be22-170fb8a7e76f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:00.681831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9223b33-1ef0-4a7a-96d8-e85ee5e191a8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:00.702542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2236a-4f2c-40f7-9989-fb0e5210525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:00.703172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2236a-4f2c-40f7-9989-fb0e5210525d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.703442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2236a-4f2c-40f7-9989-fb0e5210525d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.703759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2236a-4f2c-40f7-9989-fb0e5210525d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.714887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2236a-4f2c-40f7-9989-fb0e5210525d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:00.716143 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2236a-4f2c-40f7-9989-fb0e5210525d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:00.726998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:00.727884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.728379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.728847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.729782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:00.730288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-67f2236a-4f2c-40f7-9989-fb0e5210525d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:00.731309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:00.732215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:00.733079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:00.733079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:00.733079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:00.734517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:00.737032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 315/631] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:00.738913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4146-2268-41de-8fab-b9f92912d0a8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.739192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4146-2268-41de-8fab-b9f92912d0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.739460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4146-2268-41de-8fab-b9f92912d0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.750647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 317/632] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:00.751827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:00.762778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7bea4146-2268-41de-8fab-b9f92912d0a8 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:00.763777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7bea4146-2268-41de-8fab-b9f92912d0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:00.832370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:00.844535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 316/633] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:00.849217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4146-2268-41de-8fab-b9f92912d0a8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:00.850137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:00.872814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3fb01-ec48-42c3-afef-fda8b30865a0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:00.909365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:00.909976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:00.910248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:00.910518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:00.911154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:00.911452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:00.913186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:00.931930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 318/634] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:00.933045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:00.976411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4146-2268-41de-8fab-b9f92912d0a8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.011951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.012606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.012895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.013144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/982dd41852574cd0a7db4184da3141ef/roles/e1851a550fc04d8fb28a3fbaafed04de` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.029748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=982dd41852574cd0a7db4184da3141ef, role_id=e1851a550fc04d8fb28a3fbaafed04de)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.031405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.049304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 317/635] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:43:00 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/982dd41852574cd0a7db4184da3141ef/roles/e1851a550fc04d8fb28a3fbaafed04de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:43:01.050570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.074720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0054-4c05-421b-ab2c-fb987e7b3666 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.102298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:01.123966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0ae0-55f4-4f62-a3fc-f40394836d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.125735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0ae0-55f4-4f62-a3fc-f40394836d55 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.126189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0ae0-55f4-4f62-a3fc-f40394836d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.126461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0ae0-55f4-4f62-a3fc-f40394836d55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.135658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:01.140059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be0ae0-55f4-4f62-a3fc-f40394836d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-48be0ae0-55f4-4f62-a3fc-f40394836d55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:01.145493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:01.146509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:01.147336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 319/636] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:01.149391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551455ab-7245-4b0e-8fe5-9a11c477a517 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.149595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551455ab-7245-4b0e-8fe5-9a11c477a517 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.149820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551455ab-7245-4b0e-8fe5-9a11c477a517 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.153457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 320/637] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:01.154955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551455ab-7245-4b0e-8fe5-9a11c477a517 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.176360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ddb90-8b8d-49a4-9e39-aff443e5ccd8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.214040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.214687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.214970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.215226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.223191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.224934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:01.238751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:01.239710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:01.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 318/638] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:01.241064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.283448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551455ab-7245-4b0e-8fe5-9a11c477a517 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.321549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402df5-cb85-46d8-a499-c8cf9661c294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.322192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402df5-cb85-46d8-a499-c8cf9661c294 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.322465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402df5-cb85-46d8-a499-c8cf9661c294 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.322729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402df5-cb85-46d8-a499-c8cf9661c294 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.332989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402df5-cb85-46d8-a499-c8cf9661c294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fe402df5-cb85-46d8-a499-c8cf9661c294 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:01.338506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:01.339689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 321/639] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:01.340887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211850-c7b8-4d8b-a9ca-22cf70eb848d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.341870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211850-c7b8-4d8b-a9ca-22cf70eb848d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.341870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211850-c7b8-4d8b-a9ca-22cf70eb848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.359677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-00211850-c7b8-4d8b-a9ca-22cf70eb848d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:01.359854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:01.360842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-00211850-c7b8-4d8b-a9ca-22cf70eb848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:01.364621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d1156-3138-4d2b-b695-d7aa7143b499 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.401107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.401987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.402268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.402541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.403215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:01.403513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.404895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.413895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 319/640] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:01.414829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.422018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:01.435420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 322/641] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:01.436475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211850-c7b8-4d8b-a9ca-22cf70eb848d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.529874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8718-22ee-4d10-93c3-fb25daa2aef7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.563904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00211850-c7b8-4d8b-a9ca-22cf70eb848d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.575847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.577144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.577903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.578407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.579569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:01.580524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.583335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.605239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 320/642] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:01.605239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.618904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.619448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.619728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.620001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.621197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:01.621517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.623306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.638228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 323/643] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:01.638228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.640890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:01.708919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:01.742983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b272f9-462b-44ed-b489-f5907b743af6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.765992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc2a6-513e-4315-9db4-dfd37269616f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.778306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.779151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.779425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.779698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.790543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.791990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.805480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.806086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.806358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.806624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.807351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=84d136bca97e446a888c1b51a5b761a2) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:01.807542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:01.808549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:01.810076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:01.810076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:01.810076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:01.810263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.810336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 321/644] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:01.810336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.813618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.821343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 324/645] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/role_assignments?user.id=84d136bca97e446a888c1b51a5b761a2&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:01.822593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:01.898186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:01.926678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d120b26-d8be-4127-a0b5-69710aeaa1a0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.968755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:01.969431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:01.969638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:01.969913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:01.973202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830d25a-e04e-4733-b11e-12e0557c177d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:01.983736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:01.985268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:01.996055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:02.001464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:02.002428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:02.004835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:02.004835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:02.004835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:02.004835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 322/646] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:02.004835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.026663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.027309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.028192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.028192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.040221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:02.046375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:02.047316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 325/647] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:02.048725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.133379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1deb-baf2-49c2-a90c-c2f4edf75717 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.165608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:02.177752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.178814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.179624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.180292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.181116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:02.181689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.182400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568c9b6-2b42-4a51-9497-b7471d8e02f9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.183382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.199314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 323/648] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:02.205060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.245982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.247306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.247976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.249238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.250614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:02.251779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.256398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.289028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 326/649] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:02.291022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.315363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90fe9f-171d-4012-b84b-aae2e0e05fce None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.354100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.354856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.355233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.355623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.356385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:02.356839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.358367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.361068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:02.374784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 324/650] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:02.374784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.429801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:02.485913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c5bba-e537-408e-ab11-726c746f5f90 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.486547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9167f-255b-4823-a14a-70a6f12c57e9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.521675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.522302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.522578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.522847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.530388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.531832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:02.543375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:02.545109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 325/651] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:02.546952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.555534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.556176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.556509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.556772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] PATH_INFO: `/v3/users/glance` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.564530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.566392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:02.580037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:02.581515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:43:02.582729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:02.585512 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 327/652] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:02.586384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.679678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1edba-16e6-4cfb-ad1b-9d0257829b8a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.689505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:02.707781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:02.715851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc3de0-4262-49f8-9656-afddc0115bba None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.719988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.720332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.720702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.721090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.733330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.734980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:02.749646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:02.750802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:02.751905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:02.751905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:02.751905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:02.760163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.760988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.761433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.761684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 326/653] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:02.762087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.762787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.763131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:02.763713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.765455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.789997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 328/654] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:02.791284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.884625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36e81f-2530-4da1-8a95-116d05724b3e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.908922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac3b2-c16a-4da0-91a7-52ee345bcaff None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:02.927600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.928601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.929344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.929784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.930667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:02.931119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.933279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.948234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:02.948954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:02.949358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:02.949718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:02.950504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:02.950894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:02.952372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:02.957114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 327/655] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:02.963910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.972238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 329/656] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:02.973829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:02.991930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:02.993740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.085478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2943385-0e09-4d67-b820-a2f5cbc53263 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.090529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f02db-2479-4977-85dc-c5a8876a7313 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.124292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:03.125284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.125758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.126238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.128501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:03.129109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.129412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.129687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.204321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:03.205449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:03.205793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:03.207421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:03.224861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.234473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.341265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 330/657] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:03.343355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:03.355774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 328/658] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:03.356644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:03.466053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd55609-1b52-4775-b16b-418fa72d0fa5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.466232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7278-019a-49ec-afc4-3b315721490a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.485193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.485710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.505473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:03.506105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.506382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.506651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.510830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4ce95-6112-4904-8f6c-35625a98bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:03.511453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ce95-6112-4904-8f6c-35625a98bfcd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.511724 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ce95-6112-4904-8f6c-35625a98bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.511987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ce95-6112-4904-8f6c-35625a98bfcd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.517517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:03.519547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:03.519657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4ce95-6112-4904-8f6c-35625a98bfcd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:03.521043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4ce95-6112-4904-8f6c-35625a98bfcd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b5c4ce95-6112-4904-8f6c-35625a98bfcd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:03.532915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:03.534013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:43:03.535573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:03.536125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:03.542878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:03.545254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:03.545254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:03.545254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:03.545254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 329/659] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:03.545254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:03.547368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 331/660] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:03.547368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca8ef-c3c5-4f0d-ab63-1dd53b9a613d None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.547368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca8ef-c3c5-4f0d-ab63-1dd53b9a613d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.547368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca8ef-c3c5-4f0d-ab63-1dd53b9a613d None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.547368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 332/661] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:03.547368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ca8ef-c3c5-4f0d-ab63-1dd53b9a613d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:03.653038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2ac4-f1cf-421f-8d8d-0551cbe02549 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.667721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ca8ef-c3c5-4f0d-ab63-1dd53b9a613d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.693065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:03.693742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.694021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.694291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.704581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df437ab-1884-4f22-8e12-1d6a510a9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:03.705132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df437ab-1884-4f22-8e12-1d6a510a9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.705252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:03.705440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df437ab-1884-4f22-8e12-1d6a510a9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.705715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df437ab-1884-4f22-8e12-1d6a510a9fc0 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.706516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df437ab-1884-4f22-8e12-1d6a510a9fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:03.706741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:03.706840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df437ab-1884-4f22-8e12-1d6a510a9fc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:03.708210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df437ab-1884-4f22-8e12-1d6a510a9fc0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:03.721071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:03.722197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:03.723661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:03.723661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:03.723661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:03.723661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 330/662] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:03.723661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:03.732297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 333/663] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Sep 19 11:43:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:03.733390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5101fc-cadb-44f3-902c-158172277a54 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.733679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5101fc-cadb-44f3-902c-158172277a54 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.733951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5101fc-cadb-44f3-902c-158172277a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.752982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1c5101fc-cadb-44f3-902c-158172277a54 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:03.754312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1c5101fc-cadb-44f3-902c-158172277a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:03.755447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.785991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.839578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119765cf-80e8-4b7d-9c6e-885965420032 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.841556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 334/664] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:03.843575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5101fc-cadb-44f3-902c-158172277a54 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:03.875801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:03.876697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:03.876697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:03.876969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:03.877607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:03.877910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:03.879862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:03.896739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 331/665] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:03.897677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:03.973377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5101fc-cadb-44f3-902c-158172277a54 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:03.993425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.013957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fd923-1859-4ca6-9d68-289b46c39ae7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.017578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.017578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.017845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.018247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.019675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:04.020051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.021561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.035369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 335/666] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:04.036350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.053672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.054644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.055101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.055549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.067078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.143799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.145750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.162779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b629e-816b-4733-a36d-144e1e5115f3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.199975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.200600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.200878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.201167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.208449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.209901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:04.220749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:04.222604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:04.223545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 336/667] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:04.224291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.233421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.254453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 332/668] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:04.255485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.311683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.330520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9b97c-7a28-4dfe-8af4-85ff8814d4a9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.358463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d177a7-bb08-44c5-914c-d8200046305e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.364488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a1c5-d220-4766-b62f-150d90653dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.365112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a1c5-d220-4766-b62f-150d90653dbd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.365420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a1c5-d220-4766-b62f-150d90653dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.365697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a1c5-d220-4766-b62f-150d90653dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.372281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a1c5-d220-4766-b62f-150d90653dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.373789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a1c5-d220-4766-b62f-150d90653dbd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6272a1c5-d220-4766-b62f-150d90653dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:04.385536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:04.386380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:04.387302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:04.391255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 337/669] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:04.392459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70a40a-44ee-403f-97e6-782fd9766a27 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.392746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70a40a-44ee-403f-97e6-782fd9766a27 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.392849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.393027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70a40a-44ee-403f-97e6-782fd9766a27 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.393493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.394453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.394753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.395043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 338/670] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:04.395738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70a40a-44ee-403f-97e6-782fd9766a27 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.408960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:04.414125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:04.415034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:04.415844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 333/671] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:04.417005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.459836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.496568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70a40a-44ee-403f-97e6-782fd9766a27 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.516425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76801c3-561e-40bd-98ef-b8b29faa890a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.529681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.530279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.530555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.530832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.531521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:04.531823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.533274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.545207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 339/672] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:04.545842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.548325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.554773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b9c75-209d-42f4-8f81-e8422910d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.555426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9c75-209d-42f4-8f81-e8422910d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.555703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9c75-209d-42f4-8f81-e8422910d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.555973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9c75-209d-42f4-8f81-e8422910d5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.567029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b9c75-209d-42f4-8f81-e8422910d5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.568470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b9c75-209d-42f4-8f81-e8422910d5d1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-3a5b9c75-209d-42f4-8f81-e8422910d5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:04.582969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:04.583912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:04.584793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:04.584793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:04.584793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:04.584793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 334/673] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:04.585197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b53bf-173f-4d2c-ae8c-dfb3b94d8753 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.585615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b53bf-173f-4d2c-ae8c-dfb3b94d8753 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.585724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b53bf-173f-4d2c-ae8c-dfb3b94d8753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.602968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f54b53bf-173f-4d2c-ae8c-dfb3b94d8753 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:04.604163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f54b53bf-173f-4d2c-ae8c-dfb3b94d8753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:04.649978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6de88-e376-4823-bd0e-06f6b5b6acd8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.676443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 335/674] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:04.677385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b53bf-173f-4d2c-ae8c-dfb3b94d8753 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.684797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.685436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.685718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.685989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.686676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:04.686980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.688398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.700939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 340/675] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:04.701786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.708686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.767647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.790042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b53bf-173f-4d2c-ae8c-dfb3b94d8753 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.809266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a964b46-7853-440c-8e1b-07b1ae747561 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.827304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.827912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.828188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.828457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.829120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:04.829446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.831633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.845063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:04.845692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:04.845973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:04.846245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:04.847703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=f951f4e6a8e5407580ec1ead59fdeec9) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:04.847807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 336/676] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:04.848046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:04.848618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.849750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:04.856672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 341/677] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/role_assignments?user.id=f951f4e6a8e5407580ec1ead59fdeec9&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:04.858174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:04.945300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:04.968799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a9d60-a97e-4033-a1b1-0fe7000d6e2f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:04.995793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ed194-859b-459d-9d0c-64aab118ff66 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.013321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.013978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.014217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.014489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.015153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:05.015473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.016850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.027354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:05.036570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 337/678] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:05.036570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.043537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.044144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.044415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.044683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.045441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=d84265ba2619438485db9a18f94c87aa) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:05.045743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.047158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.055314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 342/679] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:04 2022] GET /identity/v3/role_assignments?user.id=d84265ba2619438485db9a18f94c87aa&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:05.056420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.165384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f4820-fe29-48cf-9e4e-6858aeec87b2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.203550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17004543-056b-4497-97f7-e72fc63df32c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.217627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.218862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.219323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.220041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.235555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.238795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.247392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.248104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.248463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.248571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:05.248796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:05.261425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:05.262418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:05.263279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:05.263279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:05.263279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:05.264621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:05.265174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 338/680] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:05.266165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:05.271043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:05.272193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 343/681] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:05.273405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.352134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:05.391337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43247c36-b961-4d61-b2ac-8b7d3616efec None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.424334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cab6d5-2578-4bf0-b8c1-3c0bf1298b5a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.428975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.429747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.430101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.430446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.440803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.442502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:05.458734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:05.459647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 339/682] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:05.461182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.467963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.468654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.469000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.469372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.470113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:05.470484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.472056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.486654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 344/683] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:05.493248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.539427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:05.594354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152d8df-6769-4aa7-8727-773b50ccc107 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.608525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f625-adbd-4e0b-9066-193be81e7635 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.621897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:05.640478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.641993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.642393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.642807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.644010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:05.644819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.646497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.651660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.652483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.652907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.653361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.654214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:05.655256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.656834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.661800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 340/684] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:05.662874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.671952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 345/685] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:05.673262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.793120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b639-6306-491d-b2e0-0517aac03fbc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.795776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead9588-5d6f-47f4-abff-128c3006fd7a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:05.815270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:05.833375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.834002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.834280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.834546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.835912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:05.836745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:05.837234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:05.837690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:05.842806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.844245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.851253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:05.853239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:05.857670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:05.858658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:05.859629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 341/686] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:05.860213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:05.871241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:05.872389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:05.873540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:05.873540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:05.873540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:05.875326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 346/687] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:05.876274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:05.913964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:06.005658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f4016-ce4f-4ac4-9c80-fccda9160925 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:06.006012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c057e7-5c6a-47fe-924d-6136a44f3d36 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:06.044406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:06.045086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:06.045414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:06.045690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:06.046494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=a82e9cce21e2452ca7977b828a137c13) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:06.046808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:06.048257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:06.048400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:06.049238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:06.049722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:06.051055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:06.051994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:06.052563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:06.055297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:06.063735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 342/688] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/role_assignments?user.id=a82e9cce21e2452ca7977b828a137c13&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:06.065626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:06.077421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 347/689] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Sep 19 11:43:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:06.089127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:06.152150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:06.221402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a6f8-c0ab-4b38-91d5-f20923f1d945 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:06.266098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:06.268219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:06.273248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:06.273535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:06.274297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:06.274671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:06.276021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:06.289908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 343/690] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:06.302293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:06.302497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:06.330655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db559d-08ef-488e-84dc-61d36215f446 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:06.380660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:06.381820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:06.382293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:06.383039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:06.425338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e459b7-8861-4913-b3f4-6030a9749698 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:06.428617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:06.474367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:06.475172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:06.475548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:06.475916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:06.477001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:06.480252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:06.484904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:06.486576 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:06.500618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:06.501904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:06.503730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:06.505316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 344/691] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:43:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:06.510495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:06.586586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:06.623445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 348/692] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:06.630243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:06.692760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47bab1-3b2d-4cf7-be2b-c7e6146c028f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:06.758410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:06.759026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:06.759304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:06.759575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:06.760318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:06.760622 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:06.763151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:06.805454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 345/693] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:43:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:06.806364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:06.848408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:06.850834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974e9db-4651-415c-bd38-cf8c0c3842ae None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:06.907375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:06.908009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:06.908286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:06.908556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:06.927350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:06.928814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:06.953381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:06.954348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:06.955219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:06.955219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:06.955219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:06.955219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 349/694] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:06.962682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:06.983890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79abd9a-da3a-424c-b6e5-3557f97e70d8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:07.024070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:07.050244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09ba97-2c82-49ba-9125-709a0cccc91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:07.050873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ba97-2c82-49ba-9125-709a0cccc91c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.051158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ba97-2c82-49ba-9125-709a0cccc91c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.051413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ba97-2c82-49ba-9125-709a0cccc91c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.149542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666436-2028-446a-8927-2c4255fd90b6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:07.176066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09ba97-2c82-49ba-9125-709a0cccc91c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:07.177551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09ba97-2c82-49ba-9125-709a0cccc91c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:07.230655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:07.231196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.231473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.231746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.232401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:07.232701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:07.234115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:07.240414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:07.264058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 350/695] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:07.267363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:07.372643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:07.376040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 346/696] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:07.379231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4592d-b121-4482-a08f-ac70186884d1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.380374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4592d-b121-4482-a08f-ac70186884d1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.380956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4592d-b121-4482-a08f-ac70186884d1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.388265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 347/697] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:07.388265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4592d-b121-4482-a08f-ac70186884d1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:07.394335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475fa30-39ca-4315-b7f7-eea243f18864 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:07.482195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a187a-fa92-46b5-aa97-2a0314d7690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:07.482424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a187a-fa92-46b5-aa97-2a0314d7690b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.482649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a187a-fa92-46b5-aa97-2a0314d7690b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.482893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a187a-fa92-46b5-aa97-2a0314d7690b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.499200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a187a-fa92-46b5-aa97-2a0314d7690b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:07.500917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a187a-fa92-46b5-aa97-2a0314d7690b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:07.523329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4592d-b121-4482-a08f-ac70186884d1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-791a187a-fa92-46b5-aa97-2a0314d7690b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:07.526882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:07.527829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:07.528738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:07.532455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 351/698] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:07.533706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10466259-cc3d-4d42-879b-8460a5beef52 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.534445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10466259-cc3d-4d42-879b-8460a5beef52 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.534445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10466259-cc3d-4d42-879b-8460a5beef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.559097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:07.564600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-10466259-cc3d-4d42-879b-8460a5beef52 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:07.565882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-10466259-cc3d-4d42-879b-8460a5beef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:07.582851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273da31-bf1f-4fd4-a535-03006d0764b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:07.583487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273da31-bf1f-4fd4-a535-03006d0764b1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.583822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273da31-bf1f-4fd4-a535-03006d0764b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.584090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273da31-bf1f-4fd4-a535-03006d0764b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.595494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273da31-bf1f-4fd4-a535-03006d0764b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:07.597074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273da31-bf1f-4fd4-a535-03006d0764b1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0273da31-bf1f-4fd4-a535-03006d0764b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:07.613613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:07.614826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:07.615929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:07.615929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:07.615929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:07.621418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 348/699] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:07.622794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d7d4-409c-4162-9312-fabe34295912 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.623148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d7d4-409c-4162-9312-fabe34295912 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.623495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d7d4-409c-4162-9312-fabe34295912 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.630097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 349/700] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:07.631004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01d7d4-409c-4162-9312-fabe34295912 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:07.671334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 352/701] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:07.672575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10466259-cc3d-4d42-879b-8460a5beef52 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:07.774973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01d7d4-409c-4162-9312-fabe34295912 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:07.838293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa798b98-c6ba-4efc-988a-710971faace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:07.840097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:07.842141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798b98-c6ba-4efc-988a-710971faace0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.842737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798b98-c6ba-4efc-988a-710971faace0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.843485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798b98-c6ba-4efc-988a-710971faace0 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.845901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa798b98-c6ba-4efc-988a-710971faace0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:07.847908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa798b98-c6ba-4efc-988a-710971faace0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:07.850106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa798b98-c6ba-4efc-988a-710971faace0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:07.875975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 350/702] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:07.877593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2140f86-3b19-42c9-b6ba-8c124ada6f2f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.878109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2140f86-3b19-42c9-b6ba-8c124ada6f2f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.878683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2140f86-3b19-42c9-b6ba-8c124ada6f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.883606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10466259-cc3d-4d42-879b-8460a5beef52 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:07.905339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a2140f86-3b19-42c9-b6ba-8c124ada6f2f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:07.907514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a2140f86-3b19-42c9-b6ba-8c124ada6f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:07.940791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:07.970651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:07.971262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:07.971540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:07.972329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:07.973069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:07.973414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:07.975502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:07.997204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 353/703] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:07.997204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:07.998491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 351/704] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:07.999526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2140f86-3b19-42c9-b6ba-8c124ada6f2f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.108876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2140f86-3b19-42c9-b6ba-8c124ada6f2f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.118500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558c9a8-c92e-4d9c-abf9-6d5f81056b19 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.145249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.145978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.146322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.146657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.157263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.158983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.159852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.160751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.161191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.161585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.162441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=982dd41852574cd0a7db4184da3141ef) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:08.162759 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.164288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:08.175880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:08.176897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:08.177831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:08.177831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:08.177831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:08.177831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 352/705] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:08.178065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 354/706] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:07 2022] GET /identity/v3/role_assignments?user.id=982dd41852574cd0a7db4184da3141ef&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:08.178320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.185593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.212115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:08.221550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:08.351972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b310d-b514-4f9c-a53c-146086e5a3bb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.370769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10349e66-6fce-4ee4-8ec6-b024fc5600d3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.396197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.396828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.397114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.397423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.407812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.409338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.418059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.419012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.419295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.419570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.420215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:08.420521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.421914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:08.422382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:08.423237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 353/707] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:08.425473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.442614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 355/708] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:08.443471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.518288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:08.537389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:08.546059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cad42-03a8-4755-9fc8-0c0db95791e6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.577378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c088062-9b05-43a4-a90a-2fec792ba182 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.588063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.588994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.590029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.590455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.591699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.593876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:08.611738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:08.613562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:08.614496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:08.616455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 354/709] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:08 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:08.616455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.624456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.624998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.625301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.625573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.626270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:08.626572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.628062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.645180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 356/710] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:08.645180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.758149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e78a-ad40-44e8-8c96-ceb7e69d3ef4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.764672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9d687-99b4-4ccd-819b-1e8ec4ee6a77 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.791727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45d2a1-54a2-4d37-ad58-c2e52005998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.792335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d2a1-54a2-4d37-ad58-c2e52005998b None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.792610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d2a1-54a2-4d37-ad58-c2e52005998b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.792879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d2a1-54a2-4d37-ad58-c2e52005998b None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.793553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45d2a1-54a2-4d37-ad58-c2e52005998b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.794537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:08.794983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45d2a1-54a2-4d37-ad58-c2e52005998b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.806227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.806781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:08.807166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.807628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.807940 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.808620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:08.808853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.810340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:08.820597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 357/711] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:08.820597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.829548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 355/712] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:43:08 2022] POST /identity/v3/users => generated 254 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:08.830861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f650-a700-493b-a42f-a1019e99590d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.831219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f650-a700-493b-a42f-a1019e99590d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.831494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f650-a700-493b-a42f-a1019e99590d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.837652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 356/713] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:08.837652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51f650-a700-493b-a42f-a1019e99590d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:08.949189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71b52-e5ab-4785-a5d2-8fdcf692efa1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:08.996666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3e87-52c0-4edc-954b-cd83807fa684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:08.997459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3e87-52c0-4edc-954b-cd83807fa684 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:08.997734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3e87-52c0-4edc-954b-cd83807fa684 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:08.998007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3e87-52c0-4edc-954b-cd83807fa684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:08.998874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3e87-52c0-4edc-954b-cd83807fa684 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=84d136bca97e446a888c1b51a5b761a2) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:08.999181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3e87-52c0-4edc-954b-cd83807fa684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:08.999418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51f650-a700-493b-a42f-a1019e99590d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:09.000692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3e87-52c0-4edc-954b-cd83807fa684 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:09.013228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 358/714] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:08 2022] GET /identity/v3/role_assignments?user.id=84d136bca97e446a888c1b51a5b761a2&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:09.014906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91a6e-9418-488d-a50b-08f38b1a5d44 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:09.015190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91a6e-9418-488d-a50b-08f38b1a5d44 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:09.015464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91a6e-9418-488d-a50b-08f38b1a5d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:09.041501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1ff91a6e-9418-488d-a50b-08f38b1a5d44 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:09.042905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1ff91a6e-9418-488d-a50b-08f38b1a5d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:09.060623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:09.061876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:09.062841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:09.063314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:09.064389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:09.064892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:09.067655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:09.076460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 357/715] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:09.111485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:09.132921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 359/716] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:09.436959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:09.516097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:09.575535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ec635-31b1-4aad-8b3d-05164bea6bf7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:09.626137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:09.626777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:09.627055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:09.627327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:09.627993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:09.629592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:09.639126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:09.640110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:09.640935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 358/717] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Sep 19 11:43:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:09.648489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91a6e-9418-488d-a50b-08f38b1a5d44 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:09.801097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91a6e-9418-488d-a50b-08f38b1a5d44 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:09.841626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923cfe5-8ff8-4bed-9930-93f943f94b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:09.842227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cfe5-8ff8-4bed-9930-93f943f94b1d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:09.842505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cfe5-8ff8-4bed-9930-93f943f94b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:09.842777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923cfe5-8ff8-4bed-9930-93f943f94b1d None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:09.843409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923cfe5-8ff8-4bed-9930-93f943f94b1d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:09.843706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923cfe5-8ff8-4bed-9930-93f943f94b1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:09.845056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923cfe5-8ff8-4bed-9930-93f943f94b1d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:09.852977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 360/718] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Sep 19 11:43:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:09.858702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:10.011447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882122e-2178-4db0-8b0a-204d3f6e1f33 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:10.036523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:10.047627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7415c3-6717-404a-8a06-b4f81a543d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:10.048236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7415c3-6717-404a-8a06-b4f81a543d5c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:10.048515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7415c3-6717-404a-8a06-b4f81a543d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:10.048790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7415c3-6717-404a-8a06-b4f81a543d5c None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:10.049512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7415c3-6717-404a-8a06-b4f81a543d5c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:10.050124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7415c3-6717-404a-8a06-b4f81a543d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:10.051497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7415c3-6717-404a-8a06-b4f81a543d5c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:10.056512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 359/719] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Sep 19 11:43:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:10.797792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85af7-6f8d-4c12-b9c1-49fbe7c6d6db None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:10.798323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85af7-6f8d-4c12-b9c1-49fbe7c6d6db None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:10.798323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85af7-6f8d-4c12-b9c1-49fbe7c6d6db None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:10.800547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 361/720] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:10.805871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e305-a092-4752-921a-ecf5b32e4888 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:10.806161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e305-a092-4752-921a-ecf5b32e4888 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:10.806439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e305-a092-4752-921a-ecf5b32e4888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:10.825387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9512e305-a092-4752-921a-ecf5b32e4888 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:10.826575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9512e305-a092-4752-921a-ecf5b32e4888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:10.896034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 360/721] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:11.233181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85af7-6f8d-4c12-b9c1-49fbe7c6d6db None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:11.302654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:11.361531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85af7-6f8d-4c12-b9c1-49fbe7c6d6db None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:11.414872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:11.415543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:11.415822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:11.416098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:11.431056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:11.435973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:11.436880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:11.437739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 362/722] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:11.443362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512e305-a092-4752-921a-ecf5b32e4888 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:11.572527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512e305-a092-4752-921a-ecf5b32e4888 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:11.591509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:11.611273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f691f-2330-4b42-89c7-67fdcaaac7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:11.611883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f691f-2330-4b42-89c7-67fdcaaac7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:11.612326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f691f-2330-4b42-89c7-67fdcaaac7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:11.612544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f691f-2330-4b42-89c7-67fdcaaac7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:11.613172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f691f-2330-4b42-89c7-67fdcaaac7e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:11.613478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f691f-2330-4b42-89c7-67fdcaaac7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:11.614841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f691f-2330-4b42-89c7-67fdcaaac7e7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:11.623506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 361/723] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:11.630369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:11.686340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107ec5-8d34-459c-afab-9d9556bae633 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:11.686623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107ec5-8d34-459c-afab-9d9556bae633 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:11.687102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107ec5-8d34-459c-afab-9d9556bae633 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:11.688689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 362/724] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:11.695968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac779432-8e67-4b94-9385-d310ad60f9e2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:11.696526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac779432-8e67-4b94-9385-d310ad60f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:11.697021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac779432-8e67-4b94-9385-d310ad60f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:11.729727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ac779432-8e67-4b94-9385-d310ad60f9e2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:11.731285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ac779432-8e67-4b94-9385-d310ad60f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:11.763687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9202dfd-ada6-4b47-a1de-68a7eabdf6a1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:11.775362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:11.805035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:11.806411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:11.806838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:11.807334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:11.819315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:11.821042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:11.837756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:11.838899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:11.840001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:11.840001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:11.840001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:11.841916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 363/725] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:11.847828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:11.892488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 363/726] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:43:11.988903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eefc01-94da-43dc-beb0-0c4ba6828e04 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:11.989564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eefc01-94da-43dc-beb0-0c4ba6828e04 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:11.989564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eefc01-94da-43dc-beb0-0c4ba6828e04 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:11.990938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 364/727] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:43:11.997046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fdb3b-b75b-4e0f-8517-ba283cab3dcb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:11.997355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fdb3b-b75b-4e0f-8517-ba283cab3dcb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:11.997674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fdb3b-b75b-4e0f-8517-ba283cab3dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.004297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e0a17-5cf3-410a-a0dc-c3a4ab37d2c8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:12.026183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e35fdb3b-b75b-4e0f-8517-ba283cab3dcb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:12.027057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e35fdb3b-b75b-4e0f-8517-ba283cab3dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:12.041858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f4c5d-4232-4048-bd11-cd93f7342e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:12.042898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4c5d-4232-4048-bd11-cd93f7342e60 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.043435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4c5d-4232-4048-bd11-cd93f7342e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.043904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4c5d-4232-4048-bd11-cd93f7342e60 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.044799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f4c5d-4232-4048-bd11-cd93f7342e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:12.045376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f4c5d-4232-4048-bd11-cd93f7342e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:12.047041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f4c5d-4232-4048-bd11-cd93f7342e60 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:12.061094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 364/728] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:12.067191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e704bb-3c9a-4830-aca4-23cffd1d32b9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.067711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e704bb-3c9a-4830-aca4-23cffd1d32b9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.068207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e704bb-3c9a-4830-aca4-23cffd1d32b9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.070061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 365/729] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:12.071063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e704bb-3c9a-4830-aca4-23cffd1d32b9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:12.095753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:12.105838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 365/730] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:43:12.110992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141c7a-1da7-48c9-adf1-38b0e0d2b971 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.110992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141c7a-1da7-48c9-adf1-38b0e0d2b971 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.110992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141c7a-1da7-48c9-adf1-38b0e0d2b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.126896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3b141c7a-1da7-48c9-adf1-38b0e0d2b971 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:12.128447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3b141c7a-1da7-48c9-adf1-38b0e0d2b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:12.165860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:12.216532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 366/731] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:12.217394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141c7a-1da7-48c9-adf1-38b0e0d2b971 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:12.230055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e704bb-3c9a-4830-aca4-23cffd1d32b9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:12.265625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:12.266253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.266528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.266798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.279278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:12.280709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:12.304980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:12.306001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:12.306939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:12.311327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 366/732] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:12.319039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:12.385038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141c7a-1da7-48c9-adf1-38b0e0d2b971 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:12.422785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:12.424263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.424547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.424929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.425789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:12.427302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:12.445841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:12.450732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 367/733] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:12 2022] POST /identity/v3/services => generated 240 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:12.451591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:12.476453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a723-5b2c-4c57-85a3-7306c498732f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:12.505006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:12.594031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:12.594679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.594960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.595233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.596012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:12.596318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:12.598824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:12.619423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 367/734] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Sep 19 11:43:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:12.629826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:12.647537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d106-725c-440a-8be0-bd28f1454341 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:12.694492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:12.695126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.695617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.695725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.707196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:12.712850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:12.713816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:12.714667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:12.717362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 368/735] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:12.718423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:12.766448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61adb0-c135-4e12-9562-932fe7daa4fb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:12.815821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46e89c-bedc-4ce2-9d1f-4aaecf7edc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:12.816465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e89c-bedc-4ce2-9d1f-4aaecf7edc32 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.816704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e89c-bedc-4ce2-9d1f-4aaecf7edc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.816980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e89c-bedc-4ce2-9d1f-4aaecf7edc32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.821043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:12.832584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:12.844663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc801-072e-4b26-a1ff-bf862e090507 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:12.883176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:12.884110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:12.884567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:12.885099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:12.898023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:12.903320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:12.904242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:12.905182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 369/736] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:12.905869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:12.908663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46e89c-bedc-4ce2-9d1f-4aaecf7edc32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:12.910679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46e89c-bedc-4ce2-9d1f-4aaecf7edc32 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.011993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115eadd-8e61-49cf-ba7e-e2d30d1ae9dd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.027205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 368/737] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:12 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:13.027205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859c3f-a777-4e85-9d0d-c18e60abdd77 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.027205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859c3f-a777-4e85-9d0d-c18e60abdd77 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.027205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859c3f-a777-4e85-9d0d-c18e60abdd77 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.027205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 369/738] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:13.027205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13859c3f-a777-4e85-9d0d-c18e60abdd77 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.055636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.056565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.057015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.057448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.058242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:13.058668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.060166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.067958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.069721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 370/739] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:13.069999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.085225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.146046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13859c3f-a777-4e85-9d0d-c18e60abdd77 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.179748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36244f-f489-4563-b6f4-187f82364f9e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.180678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66439db-ce4a-4a32-82f9-d34b6345e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.181307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66439db-ce4a-4a32-82f9-d34b6345e354 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.181584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66439db-ce4a-4a32-82f9-d34b6345e354 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.181859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66439db-ce4a-4a32-82f9-d34b6345e354 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.182517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66439db-ce4a-4a32-82f9-d34b6345e354 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:13.182818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66439db-ce4a-4a32-82f9-d34b6345e354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.184174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66439db-ce4a-4a32-82f9-d34b6345e354 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.192761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 370/740] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:13.198491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ae1e-2016-4a96-8276-0e19ab848c32 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.198775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ae1e-2016-4a96-8276-0e19ab848c32 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.199054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ae1e-2016-4a96-8276-0e19ab848c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.215954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.216586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.216865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.217137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.217728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6316ae1e-2016-4a96-8276-0e19ab848c32 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:13.218906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6316ae1e-2016-4a96-8276-0e19ab848c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:13.229819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.231278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:13.245819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:13.246773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:13.247648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:13.247648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:13.247648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:13.247648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 371/741] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:13.247910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.296109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 371/742] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:13 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:43:13.306107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316ae1e-2016-4a96-8276-0e19ab848c32 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.316541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.339146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.360983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1952394-b0e6-4a89-87e2-8bfd6fd454f5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.399012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.399257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.399471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.399632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.411373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.412776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:13.427620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:13.428591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:13.429512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:13.429512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:13.429512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:13.433614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 372/743] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:13.434275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.436730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316ae1e-2016-4a96-8276-0e19ab848c32 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.483801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.485142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.485640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.486349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.499574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.501499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:13.519689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:13.520686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:13.521585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:13.521585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:13.521585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:13.523779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 372/744] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:13.524739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.546368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d309e-583d-4fc2-a675-0a4bdf5a2399 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.563745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.584306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.584916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.585205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.585473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.586111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:13.586449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.588000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.601281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 373/745] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:13.601941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.622640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.646894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5555ea-9f84-4c9f-95be-90c6ab92ec70 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.687601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.688200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.688477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.688743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.689470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:13.689765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.691684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.709530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 373/746] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:13.709530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.720078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf65d4a-32fc-473a-949b-ace42e8902b9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.758266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.759192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.759192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.759476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.760120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:13.760514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.761812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.777088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 374/747] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:13.777837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.813428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.823462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb7807-ed9d-4146-8584-bbf025c1a22f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.863353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.863962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.864240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.864527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.865208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.866560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.877501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:13.885463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 374/748] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:13 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:13.886244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:13.886357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f9619-ff45-4610-9cd0-85ffbe287917 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:13.952022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:13.952753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:13.953128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:13.953527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:13.961420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:13.963092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:13.976892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:13.978072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:13.979174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:13.985187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 375/749] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:13.985187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.040366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924e3af-2067-4c3f-95f6-80d805e745a0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.089291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.089927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.090205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.090482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.096226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:14.101111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.102739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.106664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d313d3d-19a0-4107-9738-91416ee290fe None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:14.115995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:14.116990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 375/750] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:14.118590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.151031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.152002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.152427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.152706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.162533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.163983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:14.178608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:14.179586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:14.180506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 376/751] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:43:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:14.181670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.186776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:14.232061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab164b2-9b85-49be-bd1a-904fd4fa3017 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.269232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.270006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.270349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.270692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.271473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:14.272123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.273383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.286631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 376/752] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:14.287641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.309841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a5fc-6175-4aeb-a082-83ca1b107475 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.349455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.350527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.351237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.351713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.352666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:14.353272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.355009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.379603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 377/753] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:14.380830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.394305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c296-5d0f-4c86-a690-888542822799 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.409520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:14.412301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:14.433499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.434216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.434562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.434900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.435770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:14.436205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.437658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.456701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 377/754] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:14.457840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.496066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bac87-5ce9-467e-808a-c638de2dfa67 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.533934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.535001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.535464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.536013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.537066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=982dd41852574cd0a7db4184da3141ef) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:14.537580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.539328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.545892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 378/755] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/role_assignments?user.id=982dd41852574cd0a7db4184da3141ef&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:14.547117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.563195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae0f8-8dda-4752-bee2-ea4cec5c9b40 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.603687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.604302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.604559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.604827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.616546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.618129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:14.634681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:14.635694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:14.636697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:14.636697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:14.636697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:14.640450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 378/756] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:14.642344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.669255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:14.684694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:14.709105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055b69-dfc0-400e-8c6b-0742c00aa1bf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.748456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10322e8f-99ca-4729-a0c3-c3467fe0c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.749449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10322e8f-99ca-4729-a0c3-c3467fe0c75f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.749975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10322e8f-99ca-4729-a0c3-c3467fe0c75f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.750449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10322e8f-99ca-4729-a0c3-c3467fe0c75f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.827770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10322e8f-99ca-4729-a0c3-c3467fe0c75f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.829424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10322e8f-99ca-4729-a0c3-c3467fe0c75f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.843616 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d480e-a5ff-4f95-9c7f-74ba3d9e0392 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:14.879848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194b998-1ad2-43f0-97f8-09ca8cbb0e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:14.880485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b998-1ad2-43f0-97f8-09ca8cbb0e39 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.880764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b998-1ad2-43f0-97f8-09ca8cbb0e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.881035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194b998-1ad2-43f0-97f8-09ca8cbb0e39 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.881734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b998-1ad2-43f0-97f8-09ca8cbb0e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:14.882037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b998-1ad2-43f0-97f8-09ca8cbb0e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:14.883388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194b998-1ad2-43f0-97f8-09ca8cbb0e39 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:14.900212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 379/757] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:14.900212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66807f37-31ea-4545-870e-8551c2775da3 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.900212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66807f37-31ea-4545-870e-8551c2775da3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.900212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66807f37-31ea-4545-870e-8551c2775da3 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.903328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 380/758] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:14.904108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66807f37-31ea-4545-870e-8551c2775da3 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:14.925910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:14.958006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 379/759] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:43:14.959780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2b8f-819f-4af1-ad9c-2855b1fa2969 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:14.960272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2b8f-819f-4af1-ad9c-2855b1fa2969 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:14.960782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2b8f-819f-4af1-ad9c-2855b1fa2969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:14.982911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d8db2b8f-819f-4af1-ad9c-2855b1fa2969 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:14.984356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d8db2b8f-819f-4af1-ad9c-2855b1fa2969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:15.001392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:15.017763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66807f37-31ea-4545-870e-8551c2775da3 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.056118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.056871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.057422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.057774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.066721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.068542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.073236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 380/760] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:15.074276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2b8f-819f-4af1-ad9c-2855b1fa2969 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:15.093062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:15.093982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:15.094858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:15.096315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 381/761] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:15.100021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.249969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589b9f3-61c4-4f95-936a-31c471fc2c41 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.260998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2b8f-819f-4af1-ad9c-2855b1fa2969 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.270454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:15.289765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.290745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.291463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.291841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.292941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:15.293400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.295102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.309880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 382/762] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:15.315380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.334007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:15.353772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.354415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.354690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.354953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.381237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.382703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:15.407387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:15.408384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:15.411030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:15.411030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:15.411030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:15.411030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 381/763] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:15.411030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.434022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bab4b4-a898-45fa-9338-c6f2cf641c81 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.480150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.480813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.481091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.481392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/84d136bca97e446a888c1b51a5b761a2/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.483944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=84d136bca97e446a888c1b51a5b761a2, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.485659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.506046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 383/764] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:43:15 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/84d136bca97e446a888c1b51a5b761a2/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:43:15.507386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.527307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d54210-1625-419e-aa69-2b2868352e1e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.582750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.583495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.583814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.584101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.584706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.586383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.594454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:15.606944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:15.608024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:15.608887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 382/765] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:15.622237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.634684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17d74-172e-424a-b7db-282dd90d0ee5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.677503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.678137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.678414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.678687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.679477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:15.679787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.682034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.697397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 384/766] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:15.706873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:15.708386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.834289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6557e-fc66-4d6e-9109-28ec3f57c714 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.853883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322890bf-2e65-45b9-a0e1-e3a0a0e7bba0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:15.867430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:15.879786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.880721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.881169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.881589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.900374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:15.901085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:15.901417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:15.901689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:15.902335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] RBAC: Adding query filter params (name=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:15.902631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.902916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:15.903994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.904665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:15.913801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 383/767] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:15.925775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:15.926793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:15.927681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 385/768] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:15.932915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:15.937350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:16.078807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78905c2-0dc6-4dac-91c4-3d6f55bf2991 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:16.106791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:16.117440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:16.118427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:16.118909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:16.119386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:16.120283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:16.120788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:16.122456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:16.136569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 386/769] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:16.142076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:16.145093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6fe73-16c1-4b66-93f7-f4e9a05cd140 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:16.197529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:16.228448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:16.229188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:16.229468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:16.229782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:16.230429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:16.230730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:16.233729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:16.245727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 384/770] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:16.249938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:16.300489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99b4e9-f7e3-4695-80b9-bbc87f8f87da None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:16.355669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb43c77-75cd-43be-afc2-3fc15266c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:16.356293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb43c77-75cd-43be-afc2-3fc15266c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:16.356569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb43c77-75cd-43be-afc2-3fc15266c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:16.356894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb43c77-75cd-43be-afc2-3fc15266c4a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:16.357625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb43c77-75cd-43be-afc2-3fc15266c4a8 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=05244642112b4fa689f9924cf6c17e90) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:16.357934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb43c77-75cd-43be-afc2-3fc15266c4a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:16.359564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb43c77-75cd-43be-afc2-3fc15266c4a8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:16.366661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 387/771] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:16 2022] GET /identity/v3/role_assignments?user.id=05244642112b4fa689f9924cf6c17e90&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:16.439236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222d1a1-1932-4f8b-b623-7b346a1aa2f2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:16.491897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7368f1-f2bc-425f-ba45-e4210043bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:16.492538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7368f1-f2bc-425f-ba45-e4210043bcff None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:16.492816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7368f1-f2bc-425f-ba45-e4210043bcff None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:16.493083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7368f1-f2bc-425f-ba45-e4210043bcff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:16.493838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7368f1-f2bc-425f-ba45-e4210043bcff None admin] RBAC: Adding query filter params (interface=public, service_id=b9de1a34d9014abdb053c34051297303, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:16.494144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7368f1-f2bc-425f-ba45-e4210043bcff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:16.495518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7368f1-f2bc-425f-ba45-e4210043bcff None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:16.499490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebebe-4df8-4c2c-9076-059921752743 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:16.499764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebebe-4df8-4c2c-9076-059921752743 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:16.500041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebebe-4df8-4c2c-9076-059921752743 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:16.501853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 388/772] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:16.508481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 385/773] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:43:16 2022] GET /identity/v3/endpoints?service_id=b9de1a34d9014abdb053c34051297303&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:16.514477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebebe-4df8-4c2c-9076-059921752743 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:16.515955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734486a-c563-4da7-9e0b-1deaf0b92e7c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:16.516245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734486a-c563-4da7-9e0b-1deaf0b92e7c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:16.516524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734486a-c563-4da7-9e0b-1deaf0b92e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:16.546879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8734486a-c563-4da7-9e0b-1deaf0b92e7c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:16.548081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8734486a-c563-4da7-9e0b-1deaf0b92e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:16.558345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:16.642647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebebe-4df8-4c2c-9076-059921752743 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:16.666043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:16.691701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95e07e-261c-41f0-b411-557718a9523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:16.692553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95e07e-261c-41f0-b411-557718a9523f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:16.692997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95e07e-261c-41f0-b411-557718a9523f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:16.693440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95e07e-261c-41f0-b411-557718a9523f None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:16.694456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95e07e-261c-41f0-b411-557718a9523f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:16.696443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95e07e-261c-41f0-b411-557718a9523f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:16.702710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 389/774] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:16 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:16.707019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 386/775] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:17.088618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c3ebd-2b13-4631-8926-128391f9ecf9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:17.089554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c3ebd-2b13-4631-8926-128391f9ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:17.090001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c3ebd-2b13-4631-8926-128391f9ecf9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:17.091472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 390/776] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:17.098207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f6b1-71d3-4936-8376-99afb295adf2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:17.098494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f6b1-71d3-4936-8376-99afb295adf2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:17.098768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f6b1-71d3-4936-8376-99afb295adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:17.120454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-96b3f6b1-71d3-4936-8376-99afb295adf2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:17.121674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-96b3f6b1-71d3-4936-8376-99afb295adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:17.129512 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c3ebd-2b13-4631-8926-128391f9ecf9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:17.238385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 387/777] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:17.315132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c3ebd-2b13-4631-8926-128391f9ecf9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:17.373129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:17.373700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:17.373977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:17.374244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:17.374818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:17.376155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:17.392051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:17.393091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:17.394490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 391/778] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Sep 19 11:43:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:17.401852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f6b1-71d3-4936-8376-99afb295adf2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:17.526959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:17.556321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:17.573763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f6b1-71d3-4936-8376-99afb295adf2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:17.641760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:17.643390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:17.644582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:17.644582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:17.644757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:17.648051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:17.648051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:17.654057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:17.668809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 388/779] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Sep 19 11:43:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:17.693788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:17.789601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c900e2-dd96-47b6-b307-1f0fed9e668d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:17.862589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:17.863588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:17.865437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:17.865912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:17.878634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:17.883858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:17.884774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:17.885637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:17.888248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 392/780] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:17.897299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:17.903325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c2f2-b316-460c-ae90-e5209b9a4a7b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:17.966921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:17.967989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:17.968461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:17.968919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:17.969782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:17.970297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:17.971999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:17.978528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:17.985845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 389/781] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Sep 19 11:43:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:17.991636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:18.020484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:18.024177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653795b-4e94-4841-aa79-ea1a18bc0355 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.066641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.072053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.072516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.072937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.073812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:18.074262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.075763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.085603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 393/782] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:18.091906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:18.151378 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4f987-18a3-46c4-ba9c-eb89a3d58bb6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.239398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083616c-eb61-4b9a-95ee-b4b5721dc681 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.250833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.251474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.251749 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.252021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.253285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] RBAC: Adding query filter params (interface=public, service_id=48c148421489462b85b96e31253e7bee, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:18.253607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.255146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.271155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 390/783] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:43:17 2022] GET /identity/v3/endpoints?service_id=48c148421489462b85b96e31253e7bee&interface=public®ion_id=RegionOne => generated 194 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:18.276297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:18.279042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.279666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.279938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.280265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.292226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.293757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:18.309523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:18.310527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:18.311417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:18.311417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:18.311417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:18.311417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 394/784] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:18.317648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:18.347615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:18.390200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:18.432670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ee93-5a34-4f0a-a4d0-ce0d5df7492d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.453466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c49cd-9647-4ee9-b039-673d0e39019a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.479434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214a0f-c25e-4b24-9556-6a5bd139e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.480044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214a0f-c25e-4b24-9556-6a5bd139e27f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.480319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214a0f-c25e-4b24-9556-6a5bd139e27f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.480594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214a0f-c25e-4b24-9556-6a5bd139e27f None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.481307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214a0f-c25e-4b24-9556-6a5bd139e27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.482687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214a0f-c25e-4b24-9556-6a5bd139e27f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.488937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 391/785] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:18 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:18.490339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d9117-a1b9-4a1e-89f8-e9fae8e7ea9d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.490622 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d9117-a1b9-4a1e-89f8-e9fae8e7ea9d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.490907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d9117-a1b9-4a1e-89f8-e9fae8e7ea9d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.492584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 392/786] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:18.499431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842b23-091e-4df5-bf36-5fc330747ade None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.501399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842b23-091e-4df5-bf36-5fc330747ade None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.502439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842b23-091e-4df5-bf36-5fc330747ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.506317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.507318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.507792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.508255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.509142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:18.510220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.511870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.538130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 395/787] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:18.542351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-44842b23-091e-4df5-bf36-5fc330747ade None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:18.543826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:18.546104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-44842b23-091e-4df5-bf36-5fc330747ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:18.691679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:18.703395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 393/788] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:18.721538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12950cb-b33f-441d-ac7c-dc37e8370eab None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.757692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.758372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.758650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.758920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.766348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.767772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:18.779885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:18.780837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:18.781849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 396/789] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:18.786737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842b23-091e-4df5-bf36-5fc330747ade None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:18.869504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:18.914452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842b23-091e-4df5-bf36-5fc330747ade None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.957499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbac5c-f3a9-400d-bece-eb80f7da7a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.958335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbac5c-f3a9-400d-bece-eb80f7da7a74 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.958773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbac5c-f3a9-400d-bece-eb80f7da7a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.959198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbac5c-f3a9-400d-bece-eb80f7da7a74 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.960086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbac5c-f3a9-400d-bece-eb80f7da7a74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:18.960533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbac5c-f3a9-400d-bece-eb80f7da7a74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.962122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbac5c-f3a9-400d-bece-eb80f7da7a74 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.989509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 394/790] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Sep 19 11:43:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:18.995429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.009937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eacfc-ae24-411d-a30b-fc1b4e7ce1a4 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.010542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eacfc-ae24-411d-a30b-fc1b4e7ce1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.011034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eacfc-ae24-411d-a30b-fc1b4e7ce1a4 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.012565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 395/791] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:43:19.017419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600cfc0-894e-4642-939f-0ac75a88fd82 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.017952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600cfc0-894e-4642-939f-0ac75a88fd82 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.018937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600cfc0-894e-4642-939f-0ac75a88fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.046188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0600cfc0-894e-4642-939f-0ac75a88fd82 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:19.047368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0600cfc0-894e-4642-939f-0ac75a88fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:19.122206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 396/792] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:19.123167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600cfc0-894e-4642-939f-0ac75a88fd82 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.131779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8236f7-edc4-4ce0-ae47-8b14f8f0eac0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.169753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.170798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.171328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.171955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.180273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:19.185495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:19.187213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:19.214389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:19.222225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:19.223363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:19.224524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:19.224524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:19.224524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:19.226705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 397/793] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:19.235765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.330531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600cfc0-894e-4642-939f-0ac75a88fd82 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.405439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.406078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.406357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.406623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.418681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9de3e-fca0-48ef-9c8e-1b6fd496c29b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.418886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:19.427593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:19.428537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:19.429778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:19.431043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 397/794] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:19.432529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.458378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.458991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.459269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.459536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.460246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:19.460553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:19.462646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:19.475499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 398/795] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:19.476247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.528872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:19.545178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f3744-0ceb-498a-bb41-0a44bca3940f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.553889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:19.583408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e527-1a63-490a-ac00-d5c4661dac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.583996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e527-1a63-490a-ac00-d5c4661dac6c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.584273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e527-1a63-490a-ac00-d5c4661dac6c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.584704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e527-1a63-490a-ac00-d5c4661dac6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.587317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f708fe-3447-4346-a574-975dbe9626d6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.595200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e527-1a63-490a-ac00-d5c4661dac6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-4706e527-1a63-490a-ac00-d5c4661dac6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:19.600789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:19.601818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:19.602650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 398/796] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:19.603349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749fe5-a0fe-4b89-8f02-5cf68145bbc9 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.603349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749fe5-a0fe-4b89-8f02-5cf68145bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.603988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749fe5-a0fe-4b89-8f02-5cf68145bbc9 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.605489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 399/797] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:19.606110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749fe5-a0fe-4b89-8f02-5cf68145bbc9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.632897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e1ee9-4317-4845-83c8-8698d30509de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.633546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1ee9-4317-4845-83c8-8698d30509de None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.633827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1ee9-4317-4845-83c8-8698d30509de None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.634094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1ee9-4317-4845-83c8-8698d30509de None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.634759 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1ee9-4317-4845-83c8-8698d30509de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:19.635056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1ee9-4317-4845-83c8-8698d30509de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:19.636407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1ee9-4317-4845-83c8-8698d30509de None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:19.645667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 399/798] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:19.652220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f33d4-0118-4187-985a-f2f5d9ea1813 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.652639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f33d4-0118-4187-985a-f2f5d9ea1813 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.652790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f33d4-0118-4187-985a-f2f5d9ea1813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.672236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-db2f33d4-0118-4187-985a-f2f5d9ea1813 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:19.673458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db2f33d4-0118-4187-985a-f2f5d9ea1813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:19.730111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749fe5-a0fe-4b89-8f02-5cf68145bbc9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.749483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 400/799] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:19.751213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f33d4-0118-4187-985a-f2f5d9ea1813 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.767795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.769024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.769463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.769740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.778092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:19.780098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:19.794966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:19.795878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:19.796760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:19.801490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 400/800] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:19.802333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.803032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:19.837140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:19.886164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f33d4-0118-4187-985a-f2f5d9ea1813 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.927588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a7d55-7c15-4650-92ad-753ece697aff None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:19.928151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.928806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.929090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.929391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.930113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:19.930420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:19.932311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:19.944583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 401/801] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:19.945275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:19.970178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:19.972167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:19.972874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:19.973449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:19.990339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:19.992502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:20.014761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:20.015930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:20.017031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:20.017031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:20.017031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:20.019054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 401/802] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:20.020106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.054925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.058447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26c3c9-acf2-4185-8f42-0a781237f576 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.097806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.098417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.098749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.098964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.099907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:20.100209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.101656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.114459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.120552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 402/803] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:20.120552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.140664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57dbbd-8b8a-44e6-85ee-23f6c1ef8218 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.176443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.177071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.177381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.177659 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.188946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.191073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:20.205176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:20.206592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:20.207484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:20.207484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:20.207484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:20.207484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 402/804] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:20.207484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.235335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194328b-b1db-449b-8206-2208e1d2b02b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.274167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.274718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.274991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.275259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.275843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.277332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:20.287839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:20.289021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:43:20.290067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:20.293703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 403/805] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:20.294244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.317578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5b92a-f616-48dc-8926-0f82e39b02f7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.326240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.348485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.356893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.359363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.359822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.360511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.361773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:20.362525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.364082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.381234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 403/806] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:20.381234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.419092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62adb4-a260-43ef-b52b-4a522797eca3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.455223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.456513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.456805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.457088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/982dd41852574cd0a7db4184da3141ef/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.459035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=982dd41852574cd0a7db4184da3141ef, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.460458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.485192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 404/807] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:43:20 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/982dd41852574cd0a7db4184da3141ef/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:43:20.485192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.500988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e6b5b-bfa2-43c3-9d4a-1a9f5ed74427 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.541223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.541855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.542202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.542540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.543294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:20.543674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.545050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.558059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 404/808] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:20.559044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.598965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.619935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.628180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0af8-dafc-4900-af94-1ca94d5219b9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.673054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.674810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.675342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.676098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.676973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] RBAC: Adding query filter params (name=network) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:20.677520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.679928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.691753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 405/809] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:20.691753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.704166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca32e3-4fe5-4cc0-9762-4aa1e46365e8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.745124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.746017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.746460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.746890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.758229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.760671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:20.775609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:20.776856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:20.778053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:20.780640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 405/810] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:20.782090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.810409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae2b1-a969-4e27-9c43-a8b933c08c59 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.850756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.851664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.852116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.852663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.862621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.864114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:20.878273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:20.879323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:20.880462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 406/811] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:20.881217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:20.896128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.914578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bf6b-49ec-44a5-b8ef-936f577abe86 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:20.928638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:20.964179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:20.965769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.966424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.966985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.967837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] RBAC: Adding query filter params (type=network) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:20.968574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:20.971066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:20.979518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 406/812] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:20.980897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.002341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3a667-35ed-4635-b73e-3ed09e38974a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.038723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949d120-dec4-4993-ae9b-05e87ff3ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.039329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949d120-dec4-4993-ae9b-05e87ff3ab89 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.039609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949d120-dec4-4993-ae9b-05e87ff3ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.039884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949d120-dec4-4993-ae9b-05e87ff3ab89 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.040621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949d120-dec4-4993-ae9b-05e87ff3ab89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:21.040927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949d120-dec4-4993-ae9b-05e87ff3ab89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.042381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949d120-dec4-4993-ae9b-05e87ff3ab89 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.060190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 407/813] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:21.061874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96257c5-7dca-4a6a-84bf-e664bbd8bf54 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.062361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96257c5-7dca-4a6a-84bf-e664bbd8bf54 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.062848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96257c5-7dca-4a6a-84bf-e664bbd8bf54 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.064519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 408/814] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:21.065634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96257c5-7dca-4a6a-84bf-e664bbd8bf54 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.097246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876486aa-66a6-486e-8cfd-bb441214204c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.131979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.132637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.132922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.133239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.133976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:21.134283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.135762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.139974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:21.158343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 407/815] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Sep 19 11:43:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:21.158343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.186017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96257c5-7dca-4a6a-84bf-e664bbd8bf54 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.187899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:21.223517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b93fa-770a-4144-a811-b8089ac6459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.224129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b93fa-770a-4144-a811-b8089ac6459d None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.224659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b93fa-770a-4144-a811-b8089ac6459d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.224927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b93fa-770a-4144-a811-b8089ac6459d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.225624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b93fa-770a-4144-a811-b8089ac6459d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.226978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b93fa-770a-4144-a811-b8089ac6459d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.249723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 409/816] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:21.252245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0ffb-3ce5-45f3-85b2-5dae4ab2e915 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.252777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0ffb-3ce5-45f3-85b2-5dae4ab2e915 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.253574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0ffb-3ce5-45f3-85b2-5dae4ab2e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.268104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b79ca-74f3-4730-8153-71b1ea990995 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.275980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-264b0ffb-3ce5-45f3-85b2-5dae4ab2e915 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:21.278597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-264b0ffb-3ce5-45f3-85b2-5dae4ab2e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:21.314849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.315883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.316295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.316811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.384685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 410/817] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:21.385988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0ffb-3ce5-45f3-85b2-5dae4ab2e915 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.423520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.425219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.486357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:21.581318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:21.581751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 408/818] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:43:21.584307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.635306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0ffb-3ce5-45f3-85b2-5dae4ab2e915 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.674961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.675740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.676016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.676282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.687035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.688477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.696792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a93f23-af2d-4f73-8182-a8dc469b5f54 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:21.705272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:21.706524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:21.707442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:21.707442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:21.707442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:21.707442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 411/819] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:21.712382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.736175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.736812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.737832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.738181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.739025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:21.751233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.752798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:21.770096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:21.771074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:21.772092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:21.772092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:21.772092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:21.772092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 409/820] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:21.772092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.825262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b99a1c-e8ad-4881-aab0-f4f2c3af991d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.829117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:21.866270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.866804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.867082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.867356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.868017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:21.868321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.869744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.887826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 412/821] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:21.887826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.996980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1b18-1af9-4b14-891f-6c9c80fedc58 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.998533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a74fe-e20c-4251-8121-080ed46e3c8c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.031892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.032616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.032894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.033175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.033870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.035181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.035343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.035923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.036270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.036612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.037546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:22.038143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.039478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:22.045763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:22.046694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:43:22.047496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:22.049047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Sep 19 11:43:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:22.050493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.054218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 413/823] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:22.055197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.084059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.111097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.161529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a782b5-b74f-4563-a4a8-17037d9d600c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.171676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89d1e-182b-4449-8391-e0ebe12dc65e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.197791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.198389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.198660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.198926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.199661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:22.199956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.201416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.204874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.205520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.206382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.211139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.211261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 414/824] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Sep 19 11:43:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:22.211261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.217888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.219322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:22.230668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:22.231565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:22.232448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 411/825] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:22.232940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.304376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.319881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7387d8-359b-402e-b16a-982a09dade59 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.337547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2f801-da82-4468-a65f-222426b3e2f2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.339889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.360561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.361207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.361480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.361743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.368850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.370312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.373374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.373983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.374337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.374612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.375245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:22.375547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.376887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:22.382346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:22.383201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 415/826] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:22.389743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.390283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 412/827] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Sep 19 11:43:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:22.390283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.495316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e682a-e241-4887-852c-b44bf8803ddc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.499134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c9420-f519-4538-973b-d6c8a1dd3473 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.529639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.530473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.530747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.531025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.531714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:22.532016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.533438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.535813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.536551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.536836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.537106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.537832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:22.538134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.539546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.551999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 416/828] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:22.551999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.552454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 413/829] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:22.554054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.566840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.585536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.664103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659da8-a847-4e1e-81e1-8139469eb3c3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.666886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4c11c-801b-455d-b4c8-4be5b0e30e03 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.700305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397eba-8fe0-4313-b6fc-68dee6dffcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.701310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397eba-8fe0-4313-b6fc-68dee6dffcf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.701593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397eba-8fe0-4313-b6fc-68dee6dffcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.701968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397eba-8fe0-4313-b6fc-68dee6dffcf6 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/05244642112b4fa689f9924cf6c17e90/roles/e1851a550fc04d8fb28a3fbaafed04de` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.704617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.705510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.707261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.707558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.708273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.709710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.721570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397eba-8fe0-4313-b6fc-68dee6dffcf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=05244642112b4fa689f9924cf6c17e90, role_id=e1851a550fc04d8fb28a3fbaafed04de)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.723070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397eba-8fe0-4313-b6fc-68dee6dffcf6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.732980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 417/830] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:22.733953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:22.752945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 414/831] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:43:22 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/05244642112b4fa689f9924cf6c17e90/roles/e1851a550fc04d8fb28a3fbaafed04de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:43:22.822472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.830724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f2c11-63f7-4ae4-b253-052a63968b8c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.831907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f2c11-63f7-4ae4-b253-052a63968b8c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.832401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f2c11-63f7-4ae4-b253-052a63968b8c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.835300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 415/832] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:43:22.842177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613e6b-e8ed-4a2e-ae04-c306e4f2d530 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.842877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613e6b-e8ed-4a2e-ae04-c306e4f2d530 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.843402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613e6b-e8ed-4a2e-ae04-c306e4f2d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.871062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8e613e6b-e8ed-4a2e-ae04-c306e4f2d530 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:22.872970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8e613e6b-e8ed-4a2e-ae04-c306e4f2d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:22.886848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490eb3-7cbf-4ca1-9e19-ccce1a37ca81 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:22.927703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:22.928422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:22.928768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:22.929107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:22.929951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=84d136bca97e446a888c1b51a5b761a2) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:22.930333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:22.931908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:22.938953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 418/833] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:22 2022] GET /identity/v3/role_assignments?user.id=84d136bca97e446a888c1b51a5b761a2&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:22.961023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 416/834] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:23.229305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:23.338789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f70e50-ed09-466d-81bc-bcc5632a892d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:23.364498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:23.378623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:23.379255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:23.379532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:23.379803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:23.390595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:23.397109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:23.398029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:23.398855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 419/835] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:23.404385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613e6b-e8ed-4a2e-ae04-c306e4f2d530 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:23.414719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:23.523529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613e6b-e8ed-4a2e-ae04-c306e4f2d530 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:23.559963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:23.560568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:23.560845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:23.561107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:23.561807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:23.562100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:23.563452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:23.573503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 417/836] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:23.586281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:23.693624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde9789-b2ba-4b46-a27f-d8f396992c3f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:23.732771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:23.733602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:23.733889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:23.734159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:23.747155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:23.748606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:23.764617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:23.766807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:23.768949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:23.768949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:23.768949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:23.768949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 420/837] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:23.771978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:23.847607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:23.880500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87969234-6e63-4251-b01c-cdab716f1460 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:23.917005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:23.917639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:23.917915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:23.918185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:23.918841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:23.919137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:23.920490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:23.932794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 418/838] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:23.938425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:23.975829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:24.042266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ee22f-03d6-4a0b-a633-b512bc30fb8c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:24.077303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:24.077927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:24.078261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:24.078537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:24.086706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:24.088130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:24.100783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:24.103450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:24.106000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 421/839] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:24.109855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:24.217192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a00831-4c55-492b-9544-b46e62adc0c5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:24.246361 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:24.252400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:24.253476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:24.253754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:24.254063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:24.254802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:24.255103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:24.256523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:24.279367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 419/840] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Sep 19 11:43:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:24.285179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:24.383162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:24.389695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b46f-9d28-47b5-a74a-06dcdcb5bca2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:24.427161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:24.427767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:24.428044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:24.428311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:24.500224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:24.502098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:24.597579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:24.604555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 422/841] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:43:24.610248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:24.717496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b183bc-b4eb-48b9-8314-2a8fe70d5549 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:24.752180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:24.752922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:24.753221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:24.753493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:24.763880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:24.765339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:24.780697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:24.782159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:24.783042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:24.783042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:24.783042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:24.783042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 420/842] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:24.789387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:24.892097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7a06-b60c-4a0c-84a4-f9429b29063f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:24.929266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0848b28-edac-4eec-aafc-daba8551b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:24.930254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0848b28-edac-4eec-aafc-daba8551b500 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:24.930733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0848b28-edac-4eec-aafc-daba8551b500 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:24.931201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0848b28-edac-4eec-aafc-daba8551b500 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:24.932089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0848b28-edac-4eec-aafc-daba8551b500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:24.932632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0848b28-edac-4eec-aafc-daba8551b500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:24.934285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0848b28-edac-4eec-aafc-daba8551b500 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:24.948300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 423/843] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:24.954349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.002309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:25.054838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603579d-20c6-4f49-bc51-d7d701042cb3 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.055169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603579d-20c6-4f49-bc51-d7d701042cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.055396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603579d-20c6-4f49-bc51-d7d701042cb3 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.056986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 424/844] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:43:25.061901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b2258-4b3e-47f8-8a57-142f89f60862 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.062183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b2258-4b3e-47f8-8a57-142f89f60862 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.062472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b2258-4b3e-47f8-8a57-142f89f60862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.067802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d54e-9a1e-4566-98d5-5d523fe7c748 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.081438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-309b2258-4b3e-47f8-8a57-142f89f60862 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:25.083094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-309b2258-4b3e-47f8-8a57-142f89f60862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:25.105237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836fe9d-c028-4820-8fa0-32ad594ec6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.105977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836fe9d-c028-4820-8fa0-32ad594ec6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.106329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836fe9d-c028-4820-8fa0-32ad594ec6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.106674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836fe9d-c028-4820-8fa0-32ad594ec6f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.114009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836fe9d-c028-4820-8fa0-32ad594ec6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:25.115664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836fe9d-c028-4820-8fa0-32ad594ec6f9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f836fe9d-c028-4820-8fa0-32ad594ec6f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:25.128332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:25.129296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:25.130185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 421/845] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:25.136196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8200c3-d20a-4136-a21c-00c34241d736 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.136196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8200c3-d20a-4136-a21c-00c34241d736 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.136196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8200c3-d20a-4136-a21c-00c34241d736 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.136196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 422/846] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:25.137649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8200c3-d20a-4136-a21c-00c34241d736 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.149227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:25.173324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 425/847] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:25.174936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e383-fd3d-4f20-bd9f-d5cab8138016 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.175245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e383-fd3d-4f20-bd9f-d5cab8138016 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.175559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e383-fd3d-4f20-bd9f-d5cab8138016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.205372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b6f7e383-fd3d-4f20-bd9f-d5cab8138016 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:25.207477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b6f7e383-fd3d-4f20-bd9f-d5cab8138016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:25.261122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:25.266600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8200c3-d20a-4136-a21c-00c34241d736 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.298545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 426/848] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:25.300168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41e55-ab6b-410a-b0c3-7de747b9e178 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.300460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41e55-ab6b-410a-b0c3-7de747b9e178 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.300731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41e55-ab6b-410a-b0c3-7de747b9e178 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.305846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 427/849] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:25.307099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54363-2b74-418c-8db5-67a7fc9d6fc9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.307381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54363-2b74-418c-8db5-67a7fc9d6fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.307651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a54363-2b74-418c-8db5-67a7fc9d6fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.314317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.316049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.316687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.317270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.318640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:25.319188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:25.320959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:25.327617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-57a54363-2b74-418c-8db5-67a7fc9d6fc9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:25.328887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-57a54363-2b74-418c-8db5-67a7fc9d6fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:25.335474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 423/850] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:25.341699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.417555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 428/851] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:25.451926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a54363-2b74-418c-8db5-67a7fc9d6fc9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.464713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad08d4-bf79-4bbe-934b-1893b46149a2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.500785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.501415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.501696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.501973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.503499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=982dd41852574cd0a7db4184da3141ef) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:25.503870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:25.505334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:25.511728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 424/852] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/role_assignments?user.id=982dd41852574cd0a7db4184da3141ef&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:25.514771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:25.578773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a54363-2b74-418c-8db5-67a7fc9d6fc9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.584780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.621979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.622627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.622899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.623165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.623754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:25.625113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:25.626953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:25.636849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:25.637995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:25.638906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 429/853] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:25.645007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.734680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffce9-70fd-40f8-8e25-04110ece494c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.772505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5377343-6717-4791-9514-b85f14c3b5f7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.772865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.773493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.773767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.774151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.782995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:25.786624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:25.792146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:25.793092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:25.793974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 425/854] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:25.795252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.812245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.812849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.813124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.813422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.814055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:25.814350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:25.815936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:25.825129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 430/855] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:25.825129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.888247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:25.905374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc11bb5-dd50-4854-b020-76e016063a79 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.926277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c9c24-0880-4a34-a025-500df16a4fa1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:25.941473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.942178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.942519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.942852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.943567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:25.945095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:25.954292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:25.955391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:25.956816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 426/856] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:25.962096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:25.964746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:25.965483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:25.965858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:25.966220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:25.966986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:25.967381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:25.968817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:25.982777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 431/857] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:25.982777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:26.024228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:26.066533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a896c-31a2-4585-93a5-ed83a23565b5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:26.101176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488656e-2444-4840-80c5-5579beebd521 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:26.102142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:26.102819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:26.103097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:26.103368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:26.104000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:26.104296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:26.105703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:26.117182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 427/858] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:26.117182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:26.134201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:26.155543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:26.156253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:26.156594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:26.156929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:26.157934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:26.159273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:26.160737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:26.169316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 432/859] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:26.174413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:26.236069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cea38-942b-4abf-b682-22ce76da70e3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:26.275514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:26.276072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:26.276343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:26.276618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:26.290260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:26.292013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:26.302656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:26.306552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218e8e3-8e81-4bbd-93ec-74fb953ab7ba None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:26.312341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:26.313371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:26.314242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:26.314242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:26.314242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:26.317598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 428/860] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:26.320632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:26.359291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:26.359899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:26.360173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:26.360440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:26.361065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:26.361424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:26.363919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:26.377181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 433/861] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:26.405193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:26.453246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b9b51-3c34-4acc-92f9-c3b96cae96a2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:26.493843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:26.494461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:26.494742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:26.495016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:26.495668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:26.495968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:26.497373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:26.512196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 429/862] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:26.519316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:26.630685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e56594-f1e1-4ed3-8b3f-4889667dcdff None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:26.671184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:26.671851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:26.672126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:26.672394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:26.680748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:26.682199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:26.694613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:26.695561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:26.696488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 434/863] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:43:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:26.701762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:26.806459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c959-c32b-4886-9d34-85c8622df985 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:26.836048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:26.848605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:26.849851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:26.850331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:26.850795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:26.851745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:26.852244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:26.853889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:26.872207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 430/864] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Sep 19 11:43:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:26.878391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:26.907223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:26.989828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912a52-fa63-4c76-ad3c-63d2eb5cba6d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:27.025586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:27.026233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:27.026507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:27.026808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:27.097014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:27.098472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:27.124034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:27.211984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 435/865] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:43:27.213280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:27.321812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e979-2121-48df-9011-df1ad323bf49 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:27.357638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:27.358264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:27.358595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:27.358867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:27.369058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:27.370567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:27.385530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:27.386483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:27.387365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:27.387365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:27.387365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:27.387365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 431/866] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:27.392231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:27.494989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825769-c8fb-4866-bef0-0b276f4e80aa None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:27.520361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:27.532222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:27.532816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:27.533097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:27.533389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:27.534961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:27.535258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:27.536693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:27.551748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 436/867] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:27.556994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:27.592403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:27.677479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedee1-2b04-4aae-af23-ceeed12f35d2 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:27.717384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bb89d-23b1-4b13-bed0-d60f0ce08e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:27.718013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bb89d-23b1-4b13-bed0-d60f0ce08e51 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:27.718289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bb89d-23b1-4b13-bed0-d60f0ce08e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:27.718558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bb89d-23b1-4b13-bed0-d60f0ce08e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:27.725962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bb89d-23b1-4b13-bed0-d60f0ce08e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:27.727502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bb89d-23b1-4b13-bed0-d60f0ce08e51 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2e7bb89d-23b1-4b13-bed0-d60f0ce08e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:27.739737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:27.740630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:27.741549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 432/868] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:27.748709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:27.804391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23faf94-2117-451a-a10d-147e2111a3b9 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:27.804769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23faf94-2117-451a-a10d-147e2111a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:27.805047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23faf94-2117-451a-a10d-147e2111a3b9 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:27.806640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 433/869] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:27.811905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a6d2-ded8-4cee-9429-9168a6473bcb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:27.812185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a6d2-ded8-4cee-9429-9168a6473bcb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:27.812454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a6d2-ded8-4cee-9429-9168a6473bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:27.833186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c9f6a6d2-ded8-4cee-9429-9168a6473bcb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:27.834512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c9f6a6d2-ded8-4cee-9429-9168a6473bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:27.870799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ddcb4-6718-4c2f-a195-e40ad83f62e2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:27.922128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:27.922733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:27.923015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:27.923286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:27.923980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:27.924381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:27.925838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:27.933245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 434/870] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:27.943212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 437/871] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:27.950268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a6d2-ded8-4cee-9429-9168a6473bcb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:27.977903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:28.057939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a6d2-ded8-4cee-9429-9168a6473bcb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:28.093349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:28.093948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.094218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.094484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.095206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=05244642112b4fa689f9924cf6c17e90) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:28.095503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:28.097903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:28.109291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 435/872] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:27 2022] GET /identity/v3/role_assignments?user.id=05244642112b4fa689f9924cf6c17e90&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:28.209498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:28.265433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:28.325482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ff4c4-8a47-4eca-ae3f-6e538bf42f40 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:28.361448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3a6da-25e3-4746-978c-e9549256e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:28.362154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a6da-25e3-4746-978c-e9549256e342 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.362430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a6da-25e3-4746-978c-e9549256e342 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.362699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3a6da-25e3-4746-978c-e9549256e342 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.363283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a6da-25e3-4746-978c-e9549256e342 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:28.364638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3a6da-25e3-4746-978c-e9549256e342 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3dc3a6da-25e3-4746-978c-e9549256e342 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:28.374170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:28.376303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:28.378888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 438/873] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:28.382258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:28.490341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:28.503440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51738e-a9f0-49fb-a70f-65aa931bfb86 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:28.514245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2e4d-2338-48fa-9b3c-926ba98d0df1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.514531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2e4d-2338-48fa-9b3c-926ba98d0df1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.514785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2e4d-2338-48fa-9b3c-926ba98d0df1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.516385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 439/874] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:28.521978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe5c4a-64aa-4f3a-bd6b-ded827e5318b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.522636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe5c4a-64aa-4f3a-bd6b-ded827e5318b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.522636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe5c4a-64aa-4f3a-bd6b-ded827e5318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.541077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:28.541842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.542121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.542305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-55fe5c4a-64aa-4f3a-bd6b-ded827e5318b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:28.542490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.543017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:28.543319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:28.543555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-55fe5c4a-64aa-4f3a-bd6b-ded827e5318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:28.544680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:28.550525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 436/875] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:28.560373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:28.633343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 440/876] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:28.682282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b236a12-0046-43ab-9f8f-c64872d8a495 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:28.693203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264e5ff-30fb-46c3-a780-0dd09a053a44 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.693816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264e5ff-30fb-46c3-a780-0dd09a053a44 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.694288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264e5ff-30fb-46c3-a780-0dd09a053a44 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.696073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 441/877] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:43:28.701136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f848a-1365-4d23-a2f2-10d97e6d5d57 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.701668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f848a-1365-4d23-a2f2-10d97e6d5d57 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.702156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f848a-1365-4d23-a2f2-10d97e6d5d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.721896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-543f848a-1365-4d23-a2f2-10d97e6d5d57 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:28.723209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:28.723662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-543f848a-1365-4d23-a2f2-10d97e6d5d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:28.723871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:28.724100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:28.724630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:28.725289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:28.725592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:28.726949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:28.733133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 437/878] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:28.766047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:28.810965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 442/879] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:28.919355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:28.940394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:29.026211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d2614-da2c-4c24-9084-e6579a456f76 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:29.062005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff59aa-da94-4aa5-84fb-bc64b82c4f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:29.062855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff59aa-da94-4aa5-84fb-bc64b82c4f09 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:29.063300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff59aa-da94-4aa5-84fb-bc64b82c4f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:29.063717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff59aa-da94-4aa5-84fb-bc64b82c4f09 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:29.064529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff59aa-da94-4aa5-84fb-bc64b82c4f09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:29.066589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff59aa-da94-4aa5-84fb-bc64b82c4f09 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:29.086010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f848a-1365-4d23-a2f2-10d97e6d5d57 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:29.087082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 438/880] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:28 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:29.202147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f848a-1365-4d23-a2f2-10d97e6d5d57 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:29.251532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a30f3-c364-49b8-9e23-bce23e54b65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:29.252150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a30f3-c364-49b8-9e23-bce23e54b65a None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:29.252578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a30f3-c364-49b8-9e23-bce23e54b65a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:29.252984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a30f3-c364-49b8-9e23-bce23e54b65a None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:29.253832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a30f3-c364-49b8-9e23-bce23e54b65a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:29.255213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a30f3-c364-49b8-9e23-bce23e54b65a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:29.275084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 443/881] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:29 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:30.536012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d87da-072c-4b66-8302-d7207d5538af None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:30.536585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d87da-072c-4b66-8302-d7207d5538af None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:30.536585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d87da-072c-4b66-8302-d7207d5538af None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:30.538141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 439/882] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:30.543629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8b91-5ca4-4837-bf63-09ebdfc8b122 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:30.544058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8b91-5ca4-4837-bf63-09ebdfc8b122 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:30.544256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8b91-5ca4-4837-bf63-09ebdfc8b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:30.562742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f53e8b91-5ca4-4837-bf63-09ebdfc8b122 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:30.563925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f53e8b91-5ca4-4837-bf63-09ebdfc8b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:30.582715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:30.639407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 444/883] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:30.920319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d87da-072c-4b66-8302-d7207d5538af None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:30.996984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722966-6b4f-42bc-8ea8-91ad97e3c849 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:30.997305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722966-6b4f-42bc-8ea8-91ad97e3c849 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:30.997567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8722966-6b4f-42bc-8ea8-91ad97e3c849 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:30.999156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 445/884] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:31.004730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f41ce7-9ff2-46eb-9f13-bd99c3a3a061 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.005327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f41ce7-9ff2-46eb-9f13-bd99c3a3a061 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.005837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f41ce7-9ff2-46eb-9f13-bd99c3a3a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.006300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:31.033430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-58f41ce7-9ff2-46eb-9f13-bd99c3a3a061 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:31.033430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-58f41ce7-9ff2-46eb-9f13-bd99c3a3a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:31.035577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d87da-072c-4b66-8302-d7207d5538af None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:31.080495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:31.081450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.081893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.082343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.097883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:31.105783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:31.106958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:31.108009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:31.110539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 440/885] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Sep 19 11:43:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:31.117198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 446/886] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:31.117369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:31.228447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153f5a-c674-4264-b092-cac97f230dd6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:31.263698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:31.264333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.264612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.264884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.265612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:31.265915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:31.267336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:31.270712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:31.278861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 441/887] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Sep 19 11:43:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:31.285327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f41ce7-9ff2-46eb-9f13-bd99c3a3a061 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:31.378642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:31.388177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:31.399563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f41ce7-9ff2-46eb-9f13-bd99c3a3a061 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:31.444133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd2985-3b99-496e-9d56-fc4848de6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:31.444787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd2985-3b99-496e-9d56-fc4848de6820 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.445072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd2985-3b99-496e-9d56-fc4848de6820 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.445374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd2985-3b99-496e-9d56-fc4848de6820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.459628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd2985-3b99-496e-9d56-fc4848de6820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:31.461285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd2985-3b99-496e-9d56-fc4848de6820 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-2fdd2985-3b99-496e-9d56-fc4848de6820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:31.478531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:31.479600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:31.480501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:31.480501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:31.480501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:31.480501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 447/888] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:31.481368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbd48a-b610-4cac-bb7f-8e6a4b21869f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.481648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbd48a-b610-4cac-bb7f-8e6a4b21869f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.481920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbd48a-b610-4cac-bb7f-8e6a4b21869f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.488206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 448/889] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:31.488206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbd48a-b610-4cac-bb7f-8e6a4b21869f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:31.504531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6a81-83a1-49c3-82ed-ce11aa57193a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:31.540956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1f95c-e40d-425e-8444-896226012e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:31.541633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1f95c-e40d-425e-8444-896226012e56 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.541913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1f95c-e40d-425e-8444-896226012e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.542115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1f95c-e40d-425e-8444-896226012e56 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.542871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1f95c-e40d-425e-8444-896226012e56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:31.544141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1f95c-e40d-425e-8444-896226012e56 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:31.559502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 442/890] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:31 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:43:31.560528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60b9d-c618-4183-b05b-93cd0e481079 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.560812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60b9d-c618-4183-b05b-93cd0e481079 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.561081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b60b9d-c618-4183-b05b-93cd0e481079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.581757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-28b60b9d-c618-4183-b05b-93cd0e481079 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:31.583002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-28b60b9d-c618-4183-b05b-93cd0e481079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:31.628709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbd48a-b610-4cac-bb7f-8e6a4b21869f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:31.647035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:31.668048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 443/891] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:31.669220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff973ec-935b-4b26-bf57-b01cd5ef0748 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.669507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff973ec-935b-4b26-bf57-b01cd5ef0748 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.669779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff973ec-935b-4b26-bf57-b01cd5ef0748 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.671214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 444/892] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:31.679821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd3ef1-2dc3-41f5-89e1-eefb616236c4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.679821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd3ef1-2dc3-41f5-89e1-eefb616236c4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.679821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd3ef1-2dc3-41f5-89e1-eefb616236c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.681635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:31.690345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8175a01-747a-467d-900c-672960869086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:31.691414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8175a01-747a-467d-900c-672960869086 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.691883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8175a01-747a-467d-900c-672960869086 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.692336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8175a01-747a-467d-900c-672960869086 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.693271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8175a01-747a-467d-900c-672960869086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:31.693812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8175a01-747a-467d-900c-672960869086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:31.695535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8175a01-747a-467d-900c-672960869086 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:31.702430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-45fd3ef1-2dc3-41f5-89e1-eefb616236c4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:31.703800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-45fd3ef1-2dc3-41f5-89e1-eefb616236c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:31.710398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 449/893] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:31.717211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8175a01-747a-467d-900c-672960869086 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:31.788108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 445/894] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:31.833369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8175a01-747a-467d-900c-672960869086 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:31.868204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:31.868883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.869179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.869464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.878015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:31.879532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:31.891473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:31.892436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:31.893966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 450/895] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:43:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:31.899339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd3ef1-2dc3-41f5-89e1-eefb616236c4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:31.949072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.007928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd3ef1-2dc3-41f5-89e1-eefb616236c4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.012560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.027034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.045843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.046774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.047251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.047731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.048676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:32.049239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.050920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.069487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 446/896] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Sep 19 11:43:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:32.074738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.078720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee34592-9079-43c4-ba01-1fee64d494e8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.120248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.120880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.121165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.121877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.122468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.124211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:32.135073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:32.136086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:32.136913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 451/897] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:32.137757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.194443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91de26c-6304-4422-b99c-450445721d92 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.230215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.230817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.231094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.231366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.246289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38178c65-f09d-4006-89a8-502dddff14da None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.260033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.281754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.282518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.282661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.282808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.283228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.283720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.285613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:32.295322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:32.296307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:32.297309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 452/898] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:32.298100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.313857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.316502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.402772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8bed-5c64-4574-8616-528aa8669d3c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.427298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 447/899] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:43:32.427298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.441722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.442331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.442609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.442878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.443504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:32.443802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.445195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.455727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 453/900] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:32.455727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.500480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.511230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.534002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e70a9-e6e7-4cf7-81b0-b78634a86b93 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.569376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.570045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.570246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.570516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.570750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167e04-2c0f-42d2-8e0f-f61b45ab08dc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.571153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:32.571450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.572900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.577643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 448/901] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:32.578489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.617494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.618152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.618439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.618718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.629644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.631108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:32.645536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:32.646488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:32.647370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:32.647370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:32.647370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:32.647370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 454/902] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:32.647370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.688419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77018577-efd6-4cb3-bb33-84addaf61471 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.724135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.725087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.725387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.725989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.726276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:32.726577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.727937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.737313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 449/903] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:32.737313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.741416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.755679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.764696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de48a-7e5c-4ff2-a59e-e246c9dc0200 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.800207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.800806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.801090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.801389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.802030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:32.802333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.803674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.808536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 455/904] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:32.809334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.849949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548a30-b43b-4317-ab66-0489055294d5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.889195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.889195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.889195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.889195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.889623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:32.889623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.890866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.907755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 450/905] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:32.907755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.922343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5d07-adec-4997-b827-544be55c5ee4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.959632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.960239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.960516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.960787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.961956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] RBAC: Adding query filter params (interface=public, service_id=4a062899474a45c687c8d2dd3499a1c7, region_id=RegionOne) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:32.962323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.963912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.972225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:32.972717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 456/906] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/endpoints?service_id=4a062899474a45c687c8d2dd3499a1c7&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:32.973597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:33.000267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:33.018914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992f539-7b1d-498d-8a37-43eebe6e2c29 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:33.054690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:33.055290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.055564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.055833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.056524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] RBAC: Adding query filter params (interface=public, service_id=06e8be41719c4ead8f657d5eb46c1504, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:33.056828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:33.058216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:33.063515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 451/907] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/endpoints?service_id=06e8be41719c4ead8f657d5eb46c1504&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:33.064130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:33.090914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27ce36-5345-4328-97e0-4b56d0f0c6d4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:33.125823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:33.126373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.126650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.126920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.133918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:33.135342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:33.148090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:33.148993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:33.150116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:33.156643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 457/908] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:33.157706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:33.168211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8c56c-769c-4ed3-b68e-44f435d43288 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:33.196509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:33.204698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:33.205861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.206147 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.206419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.207209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:33.208571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:33.214772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 452/909] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:33 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:43:33.215646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:33.258679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:33.285377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb778a71-f76a-4963-9f40-521ea7183d22 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:33.328339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:33.329132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.329431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.329737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.330465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:33.331983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:33.339415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 458/910] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:33 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:43:33.340525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fa3dc-a161-4b1b-a430-6820b2c74791 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:33.382038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5f51-f058-4753-b245-9732a1a155d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:33.382584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5f51-f058-4753-b245-9732a1a155d2 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.382862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5f51-f058-4753-b245-9732a1a155d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.383131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5f51-f058-4753-b245-9732a1a155d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.383856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5f51-f058-4753-b245-9732a1a155d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:33.384155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5f51-f058-4753-b245-9732a1a155d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:33.385700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5f51-f058-4753-b245-9732a1a155d2 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:33.400217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 453/911] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:33.406087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:33.525025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec27042-8901-4c14-a659-10a231c7cd42 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:33.562428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2067-afdf-4b07-9fce-caf9bbf1480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:33.563034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2067-afdf-4b07-9fce-caf9bbf1480b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.563315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2067-afdf-4b07-9fce-caf9bbf1480b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.563589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2067-afdf-4b07-9fce-caf9bbf1480b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.564348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a2067-afdf-4b07-9fce-caf9bbf1480b None admin] RBAC: Adding query filter params (role.id=96d8c1e75df54378a1f5ee790a6d1d6d, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=05244642112b4fa689f9924cf6c17e90) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:33.564658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a2067-afdf-4b07-9fce-caf9bbf1480b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:33.566634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a2067-afdf-4b07-9fce-caf9bbf1480b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:33.573888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 459/912] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:33 2022] GET /identity/v3/role_assignments?user.id=05244642112b4fa689f9924cf6c17e90&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=96d8c1e75df54378a1f5ee790a6d1d6d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:33.882302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c571-647f-45aa-b0a4-dfdee8baa140 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.882820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c571-647f-45aa-b0a4-dfdee8baa140 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.882820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c571-647f-45aa-b0a4-dfdee8baa140 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.884406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 454/913] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:33.890029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172632fd-8781-4d09-9c3a-b64074991b9a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:33.890496 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172632fd-8781-4d09-9c3a-b64074991b9a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:33.890587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172632fd-8781-4d09-9c3a-b64074991b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:33.909473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-172632fd-8781-4d09-9c3a-b64074991b9a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:33.910583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-172632fd-8781-4d09-9c3a-b64074991b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:33.912652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:33.983183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 460/914] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:34.255308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c571-647f-45aa-b0a4-dfdee8baa140 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:34.315831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:34.369759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c571-647f-45aa-b0a4-dfdee8baa140 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:34.405763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:34.406385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:34.406663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:34.406935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:34.407520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:34.408921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:34.417984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:34.418929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:34.419763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 455/915] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:34.425472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172632fd-8781-4d09-9c3a-b64074991b9a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:34.535638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172632fd-8781-4d09-9c3a-b64074991b9a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:34.572104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:34.573048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:34.573560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:34.574041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:34.574856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:34.575364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:34.576898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:34.582827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 461/916] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:34.588339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:34.704612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dfbf-81ba-4cc9-b1fc-39a95b7e8f64 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:34.721994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:34.742313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:34.742970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:34.743253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:34.743521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:34.744152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:34.744452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:34.745890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:34.751046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 456/917] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:34.757135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:34.761441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:34.861201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc184c-c7b4-492a-8796-f94d7b6c2cb5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:34.895521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca243d2-38f7-497e-8fba-95ee353210c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:34.896138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca243d2-38f7-497e-8fba-95ee353210c3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:34.896443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca243d2-38f7-497e-8fba-95ee353210c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:34.896723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca243d2-38f7-497e-8fba-95ee353210c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:34.897452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca243d2-38f7-497e-8fba-95ee353210c3 None admin] RBAC: Adding query filter params (interface=public, service_id=2ce8c77a4ed142cc9e0b97cf2a4bb25a, region_id=RegionOne) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:34.897762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca243d2-38f7-497e-8fba-95ee353210c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:34.899164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca243d2-38f7-497e-8fba-95ee353210c3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:34.904569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 462/918] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:43:34 2022] GET /identity/v3/endpoints?service_id=2ce8c77a4ed142cc9e0b97cf2a4bb25a&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:34.911226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:35.029915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bf74a-6942-4521-9e74-436a44add58d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:35.066996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c8ba1-cfb2-4218-9921-760d8ed293d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:35.067989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c8ba1-cfb2-4218-9921-760d8ed293d3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:35.068482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c8ba1-cfb2-4218-9921-760d8ed293d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:35.068971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c8ba1-cfb2-4218-9921-760d8ed293d3 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:35.069804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c8ba1-cfb2-4218-9921-760d8ed293d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:35.071371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c8ba1-cfb2-4218-9921-760d8ed293d3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:35.078152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 457/919] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:34 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:43:35.541680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c046-8ae7-4168-96d4-4b7abab0d959 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:35.542086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c046-8ae7-4168-96d4-4b7abab0d959 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:35.542266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c046-8ae7-4168-96d4-4b7abab0d959 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:35.543879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 463/920] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:35.549778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e575-df79-4833-8e57-bd66ee258a19 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:35.550288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e575-df79-4833-8e57-bd66ee258a19 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:35.550575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e575-df79-4833-8e57-bd66ee258a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:35.569776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-47c9e575-df79-4833-8e57-bd66ee258a19 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:35.570981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-47c9e575-df79-4833-8e57-bd66ee258a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:35.615564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828c33-2f8e-4046-8f4f-60fe4d460a10 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:35.615836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:35.615938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828c33-2f8e-4046-8f4f-60fe4d460a10 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:35.616142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828c33-2f8e-4046-8f4f-60fe4d460a10 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:35.617856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 464/921] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:35.623224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787068b-9173-4a20-93d5-d423731af45b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:35.623510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787068b-9173-4a20-93d5-d423731af45b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:35.623786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787068b-9173-4a20-93d5-d423731af45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:35.643879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0787068b-9173-4a20-93d5-d423731af45b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:35.645407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0787068b-9173-4a20-93d5-d423731af45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:35.648495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 458/922] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:35.713330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:35.722348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 465/923] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:35.919224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ce15f-dabc-4848-9310-45ebe852b83a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:35.920188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ce15f-dabc-4848-9310-45ebe852b83a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:35.920665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ce15f-dabc-4848-9310-45ebe852b83a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:35.922497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 459/924] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:35.924657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787068b-9173-4a20-93d5-d423731af45b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:35.928209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b74a-4747-471d-8dfc-414d86bfe466 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:35.928718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b74a-4747-471d-8dfc-414d86bfe466 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:35.929248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b74a-4747-471d-8dfc-414d86bfe466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:35.948069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3e16b74a-4747-471d-8dfc-414d86bfe466 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:35.949627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3e16b74a-4747-471d-8dfc-414d86bfe466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:36.033265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787068b-9173-4a20-93d5-d423731af45b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.035105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 460/925] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:36.036105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b74a-4747-471d-8dfc-414d86bfe466 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.072669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.073502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.073652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.073885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.074463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.075807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:36.086352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:36.087342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:36.088267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 466/926] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:36.093593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.153781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b74a-4747-471d-8dfc-414d86bfe466 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.156058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.167506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.195521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.196983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.197545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.197988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.198974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.200919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:36.214148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:36.215298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:43:36.216389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:36.223752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c715c-25c5-4cbc-85c1-68bd1e5211f3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.223922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 461/927] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:36.225625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.260410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.261084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.261387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.261704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.262340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:36.262638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.264482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.271050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 467/928] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:36.276702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.355580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553690-9709-436a-82d0-919175d89a04 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.392473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a797e3-61f1-48a9-98e6-ac24f261e4e3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.393547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.394259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.394541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.394923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.395617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:36.395923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.397303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.402477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 462/929] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:36.403329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.422928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.436751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.437402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.437856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.438283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.438812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.439449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:36.440027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.441566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.451102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 468/930] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:36.451102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.516791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df737788-8d2d-46a4-af8e-2beb4e58f4a3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.551736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.552367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.552645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.552923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.555068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb14e-7578-495a-9bd5-ebaa6504e67f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.563066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:36.568918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:36.569897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 463/931] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:36.570745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.600070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.600672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.600949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.601255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.601885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:36.602193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.603547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.608655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 469/932] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:36.609518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.668255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.681315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.691500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2b87b-61f2-47f5-8126-34580ae5114d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.721061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1b42-d1bf-44da-af8f-c26a7d024fd1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.727372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.727984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.728261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.728530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.729324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.730750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.753798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 464/933] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:36.758486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.770111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.772119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.772778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.773342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.774902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:36.776023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.778109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.791183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 470/934] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:36.798395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:36.909519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c30a0-74c5-4adc-a66b-847ec3003771 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.923419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3fd09-adbc-4dcd-856d-3518e156a5d3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:36.937875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.956399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.957677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.958162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.958623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.959299 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.960743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:36.970024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:36.970775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:36.971511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:36.971689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:36.983360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 465/935] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:36.986225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:36.988723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:37.005566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:37.006687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:37.007595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:37.007595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:37.007595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:37.007595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 471/936] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:37.013194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:37.017127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:37.148685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fbada-cbb4-4e32-be3e-97b4ccd60d8b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:37.188822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b344c-fb2c-48e1-87a0-1e673cc1489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:37.189571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b344c-fb2c-48e1-87a0-1e673cc1489c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.190570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b344c-fb2c-48e1-87a0-1e673cc1489c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.190858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b344c-fb2c-48e1-87a0-1e673cc1489c None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.191542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b344c-fb2c-48e1-87a0-1e673cc1489c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:37.191851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b344c-fb2c-48e1-87a0-1e673cc1489c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:37.194254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b344c-fb2c-48e1-87a0-1e673cc1489c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:37.208488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 466/937] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:37.214905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:37.311334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142b4a-6651-4c56-a951-11f011bf1054 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.311605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142b4a-6651-4c56-a951-11f011bf1054 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.311879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142b4a-6651-4c56-a951-11f011bf1054 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.313479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 467/938] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:37.320399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625073ca-2dc3-4775-9fb1-48d409067835 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.320883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625073ca-2dc3-4775-9fb1-48d409067835 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.321183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625073ca-2dc3-4775-9fb1-48d409067835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.327763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c46c2b-6c4b-47ea-9ecd-1808383ab67f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:37.340773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-625073ca-2dc3-4775-9fb1-48d409067835 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:37.342004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-625073ca-2dc3-4775-9fb1-48d409067835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:37.367868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:37.368539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.369088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.369390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.379570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:37.380996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:37.396746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:37.397801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:37.398734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 472/939] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:37.403698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:37.424483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:37.430758 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:37.444926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 468/940] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:37.513363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250a66-ddeb-4a9b-803b-b273f2db4f4e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:37.549863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:37.550473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.550772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.551054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.551761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:37.552068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:37.553517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:37.576577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 473/941] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:37.578085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625073ca-2dc3-4775-9fb1-48d409067835 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:37.685191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625073ca-2dc3-4775-9fb1-48d409067835 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:37.713601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:37.723570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:37.724213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.724741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.725009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.739259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:37.741098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:37.761910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:37.763094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:37.764092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:37.764092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:37.764092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:37.765239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 469/942] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:37.770531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:37.812794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:37.830747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:37.835114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a32a1-08f4-44c1-82b2-9c1cea980836 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:37.880164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69431b-1213-4273-823c-eef36655730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:37.881111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69431b-1213-4273-823c-eef36655730c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.881806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69431b-1213-4273-823c-eef36655730c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.882088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69431b-1213-4273-823c-eef36655730c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.882683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69431b-1213-4273-823c-eef36655730c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:37.884747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69431b-1213-4273-823c-eef36655730c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-4d69431b-1213-4273-823c-eef36655730c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:37.896046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:37.897029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:37.897877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:37.905234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 474/943] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:37.906105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c156f2-07d7-4674-86f7-b87072edf19e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:37.906521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69431b-1213-4273-823c-eef36655730c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:37.951816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:37.952417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:37.952696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:37.952970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:37.954069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:37.954389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:37.956124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:37.973195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 470/944] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:37.978710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:38.027410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69431b-1213-4273-823c-eef36655730c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:38.066451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:38.067322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:38.067748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:38.068166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:38.069103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:38.069570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:38.071199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:38.081463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 475/945] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:38.082674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:38.093308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b76af5-02bf-4e2c-a31b-ecec5b7dc5e4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:38.094840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:38.096258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:38.150095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:38.150727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:38.151026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:38.151638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:38.158918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:38.160347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:38.172330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:38.173261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:38.174221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 471/946] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:38.179349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:38.209639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bfa74-4ce1-4299-bdae-08ec17aae761 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:38.249927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:38.251272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:38.252040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:38.252688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:38.253694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:38.254195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:38.255728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:38.261960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 476/947] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:38.267459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:38.305032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9af48-06bb-4deb-8565-67aeb63f0d7f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:38.341877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:38.342787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:38.343202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:38.343661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:38.344501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:38.344940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:38.346515 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:38.347632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:38.362162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 472/948] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:38.373427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:38.384785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24142a-e0af-452b-a4da-0ef6c0a7560a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:38.400588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:38.423844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4962b9-f63f-479a-90e4-7daa0b67a9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:38.424441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4962b9-f63f-479a-90e4-7daa0b67a9e0 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:38.424703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4962b9-f63f-479a-90e4-7daa0b67a9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:38.424969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4962b9-f63f-479a-90e4-7daa0b67a9e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:38.425682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4962b9-f63f-479a-90e4-7daa0b67a9e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:38.427168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4962b9-f63f-479a-90e4-7daa0b67a9e0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:38.449767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 477/949] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:43:38.501881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975cc3-c623-482a-a58d-c2a26a1afb4c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:38.552371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d8e61-39b0-4368-93e8-3b168d691f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:38.553469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8e61-39b0-4368-93e8-3b168d691f90 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:38.553968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8e61-39b0-4368-93e8-3b168d691f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:38.554441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d8e61-39b0-4368-93e8-3b168d691f90 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/05244642112b4fa689f9924cf6c17e90/roles/96d8c1e75df54378a1f5ee790a6d1d6d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:38.557006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d8e61-39b0-4368-93e8-3b168d691f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=05244642112b4fa689f9924cf6c17e90, role_id=96d8c1e75df54378a1f5ee790a6d1d6d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:38.558764 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d8e61-39b0-4368-93e8-3b168d691f90 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:38.575819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 473/950] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:43:38 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/05244642112b4fa689f9924cf6c17e90/roles/96d8c1e75df54378a1f5ee790a6d1d6d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:43:39.114991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b533-8aa1-4134-909b-9da5849b1590 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:39.115521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b533-8aa1-4134-909b-9da5849b1590 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:39.115521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b533-8aa1-4134-909b-9da5849b1590 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:39.117064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 478/951] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:39.122472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3cc99-c230-49e0-bf82-ffd034f10857 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:39.122902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3cc99-c230-49e0-bf82-ffd034f10857 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:39.123186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3cc99-c230-49e0-bf82-ffd034f10857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:39.141894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-07e3cc99-c230-49e0-bf82-ffd034f10857 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:39.144016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07e3cc99-c230-49e0-bf82-ffd034f10857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:39.216142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 474/952] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:39.363067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb2ad-ab1b-4e46-8486-514f2ac11ea0 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:39.363440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb2ad-ab1b-4e46-8486-514f2ac11ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:39.363633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beb2ad-ab1b-4e46-8486-514f2ac11ea0 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:39.365268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 479/953] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:39.370483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d0740-1530-4c7c-9681-ab651343c4e7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:39.370771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d0740-1530-4c7c-9681-ab651343c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:39.371049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d0740-1530-4c7c-9681-ab651343c4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:39.391275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-562d0740-1530-4c7c-9681-ab651343c4e7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:39.392472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-562d0740-1530-4c7c-9681-ab651343c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:39.394955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:39.470074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 475/954] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:39.499792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31beb2ad-ab1b-4e46-8486-514f2ac11ea0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:39.608090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31beb2ad-ab1b-4e46-8486-514f2ac11ea0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:39.635743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:39.644901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:39.645976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:39.646750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:39.647357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:39.648005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:39.649571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:39.655260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING keystone.server.flask.common [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 11:43:39.675310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.sql.core [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:43:39.675310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:43:39.675310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [parameters: {'id': 'e42678b81d344e27929fb69550da5edd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:43:39.675310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e42678b81d344e27929fb69550da5edd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e42678b81d344e27929fb69550da5edd. Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:43:39.682541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 11:43:39.683480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application yield resource Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise self.value Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application session.commit() Sep 19 11:43:39.684633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:43:39.685720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:43:39.686651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application result.read() Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:43:39.687423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [parameters: {'id': 'e42678b81d344e27929fb69550da5edd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:39.688273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:39.689045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e42678b81d344e27929fb69550da5edd. Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.690849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 480/955] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Sep 19 11:43:39 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:39.691695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d0740-1530-4c7c-9681-ab651343c4e7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:39.760051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:39.812177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d0740-1530-4c7c-9681-ab651343c4e7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:39.859421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:39.860050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:39.860325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:39.860593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:39.870671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:39.873019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:39.874804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:39.875234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1c3df-8bdb-42ab-9788-3d856dc71ce4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:39.889714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:39.890753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:39.891760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:39.893316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 476/956] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:39.897057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:39.921797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:39.923167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:39.923647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:39.924683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:39.926397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:39.928781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:39.942148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:39.943210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:39.944034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:39.946854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 481/957] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:39.953115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:40.014497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47314c6-b939-4c54-b282-8fdefd20cc7d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:40.023151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:40.061104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:40.062177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:40.062650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:40.063110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:40.064365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:40.065420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:40.067506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:40.078190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4392fd-a504-44ad-b75e-52a6839d77f0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:40.092943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 477/958] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:40.124702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c1f5-767e-4e36-93ad-ad67f96e2b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:40.125432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c1f5-767e-4e36-93ad-ad67f96e2b5a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:40.125624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c1f5-767e-4e36-93ad-ad67f96e2b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:40.125898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c1f5-767e-4e36-93ad-ad67f96e2b5a None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:40.126547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c1f5-767e-4e36-93ad-ad67f96e2b5a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:40.126851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c1f5-767e-4e36-93ad-ad67f96e2b5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:40.129295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c1f5-767e-4e36-93ad-ad67f96e2b5a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:40.138619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 482/959] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:40.144930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:40.211544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:40.259118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a248-9192-4272-95a6-837fb35293ae None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:40.302455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b2341-6833-4f57-9f27-1fa19d102dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:40.303473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2341-6833-4f57-9f27-1fa19d102dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:40.303967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2341-6833-4f57-9f27-1fa19d102dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:40.304432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2341-6833-4f57-9f27-1fa19d102dd5 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:40.305296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b2341-6833-4f57-9f27-1fa19d102dd5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:40.305798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b2341-6833-4f57-9f27-1fa19d102dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:40.307370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b2341-6833-4f57-9f27-1fa19d102dd5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:40.313093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 478/960] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:40.742241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8369-9b91-44ec-a6ed-aee93b165338 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:40.742559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8369-9b91-44ec-a6ed-aee93b165338 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:40.742799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc8369-9b91-44ec-a6ed-aee93b165338 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:40.744294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 483/961] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:40.749732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457148b4-18a4-47dd-84b7-9c37997ba02a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:40.750233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457148b4-18a4-47dd-84b7-9c37997ba02a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:40.750728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457148b4-18a4-47dd-84b7-9c37997ba02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:40.771364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-457148b4-18a4-47dd-84b7-9c37997ba02a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:40.772961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-457148b4-18a4-47dd-84b7-9c37997ba02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:40.846592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 479/962] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:40.890198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46496-0ef5-4257-bb89-e4dd424e172b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:40.890516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46496-0ef5-4257-bb89-e4dd424e172b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:40.890741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46496-0ef5-4257-bb89-e4dd424e172b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:40.892323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 484/963] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:40.897623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4d17-af73-4821-a483-40a8495b7165 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:40.898126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4d17-af73-4821-a483-40a8495b7165 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:40.898613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4d17-af73-4821-a483-40a8495b7165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:40.918926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d0cd4d17-af73-4821-a483-40a8495b7165 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:40.920416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d0cd4d17-af73-4821-a483-40a8495b7165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:40.970012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:40.991635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 480/964] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:41.121886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46496-0ef5-4257-bb89-e4dd424e172b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.234104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46496-0ef5-4257-bb89-e4dd424e172b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:41.248384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:41.257170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4d17-af73-4821-a483-40a8495b7165 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.275057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:41.275678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:41.275949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:41.277012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:41.277617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:41.278981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:41.293010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:41.294051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:41.294877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:41.298185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 485/965] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:41.305457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.379131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4d17-af73-4821-a483-40a8495b7165 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:41.414747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bff74-90f3-4ff8-8554-260a7c670058 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:41.423104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:41.424992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:41.425551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:41.426313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:41.440056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:41.447642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:41.448563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:41.449451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:41.456156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 481/966] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:41.457029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.457389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:41.458415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:41.458932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:41.459392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:41.460607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:41.461107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:41.463675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:41.476210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 486/967] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:41.477796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.510815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:41.535469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:41.576354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e981c-b2a4-4dcf-ab36-560cc3f64b41 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:41.610089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830b9b1-5c5b-4388-916e-97597faf771e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:41.614373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:41.614755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:41.615039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:41.615311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:41.615982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:41.616288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:41.617690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:41.631950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 482/968] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:41.633114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.653916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:41.654999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:41.655743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:41.656231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:41.657054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:41.657606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:41.662638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:41.672404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 487/969] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:41.675682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.763551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6678474-f154-41f3-b5af-fd58d9aa7b02 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:41.766778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:41.801207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3461b-4df5-4f6a-80b3-be25a9b519d8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:41.805306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:41.811152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:41.813004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:41.813315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:41.813586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:41.828238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:41.830566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:41.848335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:41.848579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:41.850044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:41.851783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:41.851783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:41.851783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:41.852155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:41.852155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:41.852155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:41.852155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] RBAC: Adding query filter params (interface=admin, service_id=2ce8c77a4ed142cc9e0b97cf2a4bb25a, region_id=RegionOne) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:41.852155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:41.852594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 483/970] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:41.852676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:41.858106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 488/971] 10.222.0.42 () {56 vars in 1249 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/endpoints?service_id=2ce8c77a4ed142cc9e0b97cf2a4bb25a&interface=admin®ion_id=RegionOne => generated 193 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:41.858740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.867129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:41.985218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f6729-244f-4939-898b-4ecdb09d8970 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:42.004528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ac851-2520-47b5-a4b4-58e5b90d8cf9 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:42.021565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:42.022099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.022381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.022672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.023308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:42.023611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:42.024968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:42.042456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 484/972] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:42.044212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:42.060282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:42.061589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.062068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.062971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.064063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:42.065980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:42.067934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:42.081410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 489/973] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:41 2022] GET /identity/v3/services => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:43:42.165338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b475c-d4bd-4775-bfff-1f4c5867fbe5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:42.204131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:42.204773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.205048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.205911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.214131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:42.215603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:42.229258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:42.230266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:42.231194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 485/974] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:43:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:42.238621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:42.278036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:42.358946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7969f-a7d8-4ab0-b8e3-81a151c8f6e7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:42.395861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423accf-6b62-454c-a9a3-a74f0402832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:42.396843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423accf-6b62-454c-a9a3-a74f0402832d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.397355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423accf-6b62-454c-a9a3-a74f0402832d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.397823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423accf-6b62-454c-a9a3-a74f0402832d None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.398739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423accf-6b62-454c-a9a3-a74f0402832d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:42.399251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423accf-6b62-454c-a9a3-a74f0402832d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:42.400906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423accf-6b62-454c-a9a3-a74f0402832d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:42.420292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 490/975] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Sep 19 11:43:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:42.427419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:42.441785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7645b-76f5-4a5e-88c1-949c83b25528 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.442972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7645b-76f5-4a5e-88c1-949c83b25528 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.443447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7645b-76f5-4a5e-88c1-949c83b25528 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.446191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 491/976] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:42.452706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258a5c9-6cf8-4a8b-8a20-1976111b0238 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.453011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258a5c9-6cf8-4a8b-8a20-1976111b0238 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.453261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258a5c9-6cf8-4a8b-8a20-1976111b0238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.477760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c258a5c9-6cf8-4a8b-8a20-1976111b0238 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:42.479292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c258a5c9-6cf8-4a8b-8a20-1976111b0238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:42.529903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:42.560281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f213f-43c3-4ae9-b9bf-cfdc9e12cbf0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:42.565186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 492/977] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:42.565186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e2ab-f999-4fc6-9d8f-f5e088ee4d5f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.565186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e2ab-f999-4fc6-9d8f-f5e088ee4d5f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.565186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e2ab-f999-4fc6-9d8f-f5e088ee4d5f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.569235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 493/978] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:42.572368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b6ce1-7eef-4de2-9441-e0c99e9aebb7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.573010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b6ce1-7eef-4de2-9441-e0c99e9aebb7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.573323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b6ce1-7eef-4de2-9441-e0c99e9aebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.597172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d75b6ce1-7eef-4de2-9441-e0c99e9aebb7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:42.598348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d75b6ce1-7eef-4de2-9441-e0c99e9aebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:42.598757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:42.599415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.599946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.600217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.619470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:42.684392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 494/979] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:42.698371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:42.700143 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:42.784281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:42.808697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 486/980] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:43:42.814343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b6ce1-7eef-4de2-9441-e0c99e9aebb7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:42.843244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:42.925943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b6ce1-7eef-4de2-9441-e0c99e9aebb7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:42.961900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:42.962535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:42.962817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:42.963086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:42.971638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7775bd-ba85-409b-89b0-8d705cd159af None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:42.974927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:42.976377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:42.993026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:42.994024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:42.995060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:42.995060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:42.995060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:42.997501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 495/981] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:43.000001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:43.003017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:43.019773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.020379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.020662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.020931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.021626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.023047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.025588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING keystone.server.flask.common [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 11:43:43.038046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.sql.core [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:43:43.038046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:43:43.038046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [parameters: {'user_id': '25d3ba814baf48fd90c2f8c787d51495', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:43:43.038046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result.read() Sep 19 11:43:43.054859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:43:43.055813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application yield resource Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise self.value Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application session.commit() Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:43:43.056792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:43:43.057841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:43:43.058744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application result.read() Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:43:43.061588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [parameters: {'user_id': '25d3ba814baf48fd90c2f8c787d51495', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:43.063913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 11:43:43.066407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 487/982] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Sep 19 11:43:42 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:43.069267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:43.107406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:43.121881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e047aa4-f921-4d16-b8af-5cfac128e1cd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:43.158848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.159457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.159772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.160010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.160720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:43.161495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.162891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.174783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a7feb-caed-4cfa-91dd-a05306f8ec8c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:43.179503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 496/983] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:43.179503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:43.216681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.217325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.217604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.217874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.218529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.220265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.238990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 488/984] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:43 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:43.239794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:43.246275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:43.294876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1a611-80c7-4a32-934f-b964203c9719 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:43.350091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.351247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.351732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.352329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.362400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.364339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.365555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:43.371215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518b15d-a765-4f2e-90c3-25e55cb69f62 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:43.382116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:43.383182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:43:43.384144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:43.386984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 497/985] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:43.395369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:43.424579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.425757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.426172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.426455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.435805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.437714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:43.451309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:43.452250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:43.453350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 489/986] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:43.459976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:43.511876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1c782-0598-4f8d-8513-bb37059b272d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:43.534523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:43.560584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.561369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.561768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.562245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.563011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:43.563402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.565009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.574995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803a71-b1b2-4a15-80a9-2bc3465ee5b0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:43.608743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 498/987] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Sep 19 11:43:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:43.618507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733207b1-bc80-450a-bea2-9142747757f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.619149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733207b1-bc80-450a-bea2-9142747757f9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.619430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733207b1-bc80-450a-bea2-9142747757f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.619699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733207b1-bc80-450a-bea2-9142747757f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.620649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733207b1-bc80-450a-bea2-9142747757f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:43.621005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733207b1-bc80-450a-bea2-9142747757f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.622518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733207b1-bc80-450a-bea2-9142747757f9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.637777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 490/988] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:43.644636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:43.783341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf36c-d0f5-4311-b17c-8397297d41b8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:43.821675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3393bce-b69d-4afd-b209-43d45c302bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:43.822609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3393bce-b69d-4afd-b209-43d45c302bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:43.823083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3393bce-b69d-4afd-b209-43d45c302bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:43.823533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3393bce-b69d-4afd-b209-43d45c302bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:43.824511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3393bce-b69d-4afd-b209-43d45c302bb4 None admin] RBAC: Adding query filter params (role.id=96d8c1e75df54378a1f5ee790a6d1d6d, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=05244642112b4fa689f9924cf6c17e90) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:43.824995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3393bce-b69d-4afd-b209-43d45c302bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:43.826607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3393bce-b69d-4afd-b209-43d45c302bb4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:43.834639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 499/989] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:43 2022] GET /identity/v3/role_assignments?user.id=05244642112b4fa689f9924cf6c17e90&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=96d8c1e75df54378a1f5ee790a6d1d6d => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:44.392132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3a86b-abd2-4212-9772-cd4dbf15eef7 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:44.392536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3a86b-abd2-4212-9772-cd4dbf15eef7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:44.393393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3a86b-abd2-4212-9772-cd4dbf15eef7 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:44.394884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 491/990] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:44.399963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97432f-7fbd-4897-ab4a-e506f972267e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:44.400412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97432f-7fbd-4897-ab4a-e506f972267e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:44.400501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97432f-7fbd-4897-ab4a-e506f972267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:44.418846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fc97432f-7fbd-4897-ab4a-e506f972267e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:44.420033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fc97432f-7fbd-4897-ab4a-e506f972267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:44.456060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:44.490606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 500/991] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:44.758818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3a86b-abd2-4212-9772-cd4dbf15eef7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:44.778967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:44.863733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3a86b-abd2-4212-9772-cd4dbf15eef7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:44.897197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:44.897820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:44.898101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:44.898375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:44.898955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:44.900310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:44.910145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:44.911112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:43:44.912042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:44.913429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 492/992] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Sep 19 11:43:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:44.917012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97432f-7fbd-4897-ab4a-e506f972267e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:45.020107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97432f-7fbd-4897-ab4a-e506f972267e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:45.054953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:45.055556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:45.055833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:45.056102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:45.056734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:45.057034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:45.058414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:45.067954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 501/993] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:45.068921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:45.152276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:45.171975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3971122-7add-4f24-888e-47d4050bd1dc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:45.205817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08bdd2-dccb-493a-9b04-1cbb8b13e8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:45.206597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bdd2-dccb-493a-9b04-1cbb8b13e8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:45.206879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bdd2-dccb-493a-9b04-1cbb8b13e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:45.207151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bdd2-dccb-493a-9b04-1cbb8b13e8b4 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:45.207785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08bdd2-dccb-493a-9b04-1cbb8b13e8b4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:45.208088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08bdd2-dccb-493a-9b04-1cbb8b13e8b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:45.209469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08bdd2-dccb-493a-9b04-1cbb8b13e8b4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:45.218944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 493/994] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Sep 19 11:43:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:45.220181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:45.256134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:45.326855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ffb62-114b-4aea-975f-81a2fbc58358 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:45.363509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8dfbf-fca9-4c58-91dd-aae8eaab713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:45.364228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8dfbf-fca9-4c58-91dd-aae8eaab713c None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:45.364510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8dfbf-fca9-4c58-91dd-aae8eaab713c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:45.364780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8dfbf-fca9-4c58-91dd-aae8eaab713c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:45.365539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8dfbf-fca9-4c58-91dd-aae8eaab713c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:45.366957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8dfbf-fca9-4c58-91dd-aae8eaab713c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:45.393340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 502/995] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:45.537649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee90b0-15aa-4f68-98d3-209f78231dc6 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:45.537837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee90b0-15aa-4f68-98d3-209f78231dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:45.538104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee90b0-15aa-4f68-98d3-209f78231dc6 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:45.539632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 494/996] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:45.545253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0bcf-ad80-4bb5-ba86-30e6e03c832e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:45.545764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0bcf-ad80-4bb5-ba86-30e6e03c832e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:45.545841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0bcf-ad80-4bb5-ba86-30e6e03c832e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:45.565068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c51d0bcf-ad80-4bb5-ba86-30e6e03c832e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:45.566389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c51d0bcf-ad80-4bb5-ba86-30e6e03c832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:45.645003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 503/997] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:45 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:45.931149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee90b0-15aa-4f68-98d3-209f78231dc6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.041531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee90b0-15aa-4f68-98d3-209f78231dc6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.076193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.076823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.077402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.077516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.078032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.078869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4684-2642-43aa-bdab-4c0cc1b88b75 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.079160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4684-2642-43aa-bdab-4c0cc1b88b75 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.079437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4684-2642-43aa-bdab-4c0cc1b88b75 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.079534 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.081036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 504/998] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:46.085847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d720-4330-4cae-b028-5add8ab73a73 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.086132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d720-4330-4cae-b028-5add8ab73a73 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.086402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d720-4330-4cae-b028-5add8ab73a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:46.088757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:46.089844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:46.090676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:46.094749 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 495/999] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:46.095463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.106172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bc80d720-4330-4cae-b028-5add8ab73a73 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:46.107364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bc80d720-4330-4cae-b028-5add8ab73a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:46.109255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:46.123393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:46.180150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 505/1000] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:46 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:46.207484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f311fe-826b-4c56-877c-cb94aa0d098d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.242014 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.242617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.242899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.243170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.243798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:46.244098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.245479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.255624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 496/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:46.256764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d720-4330-4cae-b028-5add8ab73a73 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.360245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d720-4330-4cae-b028-5add8ab73a73 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.393878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.394473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.394748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.395020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.395639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:46.395935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.397319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.406874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 506/1002] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:46.408117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.454682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.476393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:46.489566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:46.517460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b9cd-e4dc-41d9-81c3-3af3ad656c83 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.556297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.557530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.557970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.558231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.558938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] RBAC: Adding query filter params (interface=public, service_id=0a1b04b8e3cb4558aa88c940acb89c9d, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:46.559249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.560602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.566379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 497/1003] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:43:46 2022] GET /identity/v3/endpoints?service_id=0a1b04b8e3cb4558aa88c940acb89c9d&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:46.571371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.574621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e6361-4e6d-40a6-9c93-460804f32c39 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.613697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.614593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.615140 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.615419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] PATH_INFO: `/v3/services/image` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.616011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.617497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:46.627253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:46.628250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:46.629232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 507/1004] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Sep 19 11:43:46 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:46.634497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.686806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e15ffa-ff5c-4ed2-9ade-405b0829e863 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.725312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.725943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.726218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.726540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.727095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.728011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:46.728441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.735013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 498/1005] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:46 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:43:46.753975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58485a54-1945-46b1-a4e8-653bb4845e12 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.792400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0e43b-cd6d-4edf-8ec6-5e1b3edc85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.793026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0e43b-cd6d-4edf-8ec6-5e1b3edc85a5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.793335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0e43b-cd6d-4edf-8ec6-5e1b3edc85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.793606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0e43b-cd6d-4edf-8ec6-5e1b3edc85a5 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.794258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0e43b-cd6d-4edf-8ec6-5e1b3edc85a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:46.794560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0e43b-cd6d-4edf-8ec6-5e1b3edc85a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.795959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0e43b-cd6d-4edf-8ec6-5e1b3edc85a5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.807189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 508/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:46.808037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:46.811232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:46.920183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42039e72-8d3e-4eed-a1eb-2b18c45974cd None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:46.955620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881671ca-1f0f-40eb-8d63-4a5fdd30e92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:46.956423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881671ca-1f0f-40eb-8d63-4a5fdd30e92e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:46.956532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881671ca-1f0f-40eb-8d63-4a5fdd30e92e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:46.956764 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881671ca-1f0f-40eb-8d63-4a5fdd30e92e None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:46.957394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881671ca-1f0f-40eb-8d63-4a5fdd30e92e None admin] RBAC: Adding query filter params (type=image) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:46.957692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881671ca-1f0f-40eb-8d63-4a5fdd30e92e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:46.959040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881671ca-1f0f-40eb-8d63-4a5fdd30e92e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:46.969230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 499/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:47.594697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527221-cac7-4945-bd9e-3cb1c9e8afd9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:47.595217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527221-cac7-4945-bd9e-3cb1c9e8afd9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:47.595217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9527221-cac7-4945-bd9e-3cb1c9e8afd9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:47.597357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 509/1008] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:47.602670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305c0e-3307-4fcf-aa48-aef637f2e0bd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:47.602964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305c0e-3307-4fcf-aa48-aef637f2e0bd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:47.603239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305c0e-3307-4fcf-aa48-aef637f2e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:47.621434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6b305c0e-3307-4fcf-aa48-aef637f2e0bd None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:47.622955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6b305c0e-3307-4fcf-aa48-aef637f2e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:47.694267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:47.705193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 500/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:47.973761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527221-cac7-4945-bd9e-3cb1c9e8afd9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:48.078463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9527221-cac7-4945-bd9e-3cb1c9e8afd9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:48.112664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f62ba-4f76-4bfb-b653-7d58acb925eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:48.113364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f62ba-4f76-4bfb-b653-7d58acb925eb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:48.113643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f62ba-4f76-4bfb-b653-7d58acb925eb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:48.113911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f62ba-4f76-4bfb-b653-7d58acb925eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:48.115015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f62ba-4f76-4bfb-b653-7d58acb925eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:48.116432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f62ba-4f76-4bfb-b653-7d58acb925eb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:48.118163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 510/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:48.123694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305c0e-3307-4fcf-aa48-aef637f2e0bd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:48.226027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305c0e-3307-4fcf-aa48-aef637f2e0bd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:48.259844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccf95e-b49e-4113-8c3e-54a182635e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:48.260449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf95e-b49e-4113-8c3e-54a182635e74 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:48.260723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf95e-b49e-4113-8c3e-54a182635e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:48.260992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccf95e-b49e-4113-8c3e-54a182635e74 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:48.261669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccf95e-b49e-4113-8c3e-54a182635e74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:48.263089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccf95e-b49e-4113-8c3e-54a182635e74 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:48.289532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 501/1011] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:48 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:48.961389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8597-2179-4c40-91d2-625a0caff97b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:48.961878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8597-2179-4c40-91d2-625a0caff97b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:48.961878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8597-2179-4c40-91d2-625a0caff97b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:48.963218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 511/1012] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:48.968373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011421db-3162-41c9-9a72-8668dba5726b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:48.968662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011421db-3162-41c9-9a72-8668dba5726b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:48.968936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011421db-3162-41c9-9a72-8668dba5726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:48.988173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-011421db-3162-41c9-9a72-8668dba5726b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:48.989389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-011421db-3162-41c9-9a72-8668dba5726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:49.037545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:49.064317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 502/1013] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:49.144465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2931f07-f2e0-4601-a1d8-e2c8c4cda0f5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:49.144802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2931f07-f2e0-4601-a1d8-e2c8c4cda0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:49.144992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2931f07-f2e0-4601-a1d8-e2c8c4cda0f5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:49.146521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 512/1014] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:49.151606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410bd96-4f34-4d01-9da9-f2697f74d7d0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:49.152079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410bd96-4f34-4d01-9da9-f2697f74d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:49.152162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410bd96-4f34-4d01-9da9-f2697f74d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:49.170262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1410bd96-4f34-4d01-9da9-f2697f74d7d0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:49.171427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1410bd96-4f34-4d01-9da9-f2697f74d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:49.242644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 503/1015] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:49.355614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2931f07-f2e0-4601-a1d8-e2c8c4cda0f5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:49.368866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:49.463461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2931f07-f2e0-4601-a1d8-e2c8c4cda0f5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:49.497975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:49.498536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:49.498816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:49.499089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:49.499673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:49.501019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:49.509952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:49.510901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:43:49.511765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:49.513125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 513/1016] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:49.516939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410bd96-4f34-4d01-9da9-f2697f74d7d0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:49.520450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:49.606876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:49.624399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410bd96-4f34-4d01-9da9-f2697f74d7d0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:49.634171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:49.636687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749294d-1267-48f2-83c7-c822c73a2c49 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:49.665817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:49.666426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:49.666710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:49.666985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:49.667648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:49.669011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:49.684139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:49.684703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:49.684976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:49.685278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:49.689201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 504/1017] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:43:49 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:43:49.689411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:49.689411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:49.689411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:49.693905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 514/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:49.699705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:49.844319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743a15e-2cb1-474f-af8e-399bc67d0fe5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:49.895427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae085f-208c-48cf-be4c-327dfb28ca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:49.896045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae085f-208c-48cf-be4c-327dfb28ca90 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:49.896324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae085f-208c-48cf-be4c-327dfb28ca90 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:49.896595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae085f-208c-48cf-be4c-327dfb28ca90 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:49.897264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae085f-208c-48cf-be4c-327dfb28ca90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:49.897568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae085f-208c-48cf-be4c-327dfb28ca90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:49.898929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae085f-208c-48cf-be4c-327dfb28ca90 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:49.904260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 505/1019] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Sep 19 11:43:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:49.910752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:50.016488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b13f5-772c-41b8-b9de-fbf5b6390783 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:50.051713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ad0fe-fc39-4eb5-9b52-74360b21409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:50.052318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ad0fe-fc39-4eb5-9b52-74360b21409c None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:50.052594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ad0fe-fc39-4eb5-9b52-74360b21409c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:50.052863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ad0fe-fc39-4eb5-9b52-74360b21409c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:50.053572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ad0fe-fc39-4eb5-9b52-74360b21409c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:50.054924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ad0fe-fc39-4eb5-9b52-74360b21409c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:50.063454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:50.076524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 515/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:43:50.537114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326b263-070e-4c79-b991-29b135f2f7c1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:50.537658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326b263-070e-4c79-b991-29b135f2f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:50.537658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326b263-070e-4c79-b991-29b135f2f7c1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:50.539161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 506/1021] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:50.544445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b2c92-d121-42dc-9e7a-f3c25ed98b65 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:50.544729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b2c92-d121-42dc-9e7a-f3c25ed98b65 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:50.545001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b2c92-d121-42dc-9e7a-f3c25ed98b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:50.563736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-049b2c92-d121-42dc-9e7a-f3c25ed98b65 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:50.565501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-049b2c92-d121-42dc-9e7a-f3c25ed98b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:50.644391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 516/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:50.918678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326b263-070e-4c79-b991-29b135f2f7c1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:50.948494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:51.027250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326b263-070e-4c79-b991-29b135f2f7c1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:51.063325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab8c2e-55df-46c3-8bb2-3f33f2ee2a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:51.063965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8c2e-55df-46c3-8bb2-3f33f2ee2a58 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:51.064237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8c2e-55df-46c3-8bb2-3f33f2ee2a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:51.065897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8c2e-55df-46c3-8bb2-3f33f2ee2a58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:51.067062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab8c2e-55df-46c3-8bb2-3f33f2ee2a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:51.068481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab8c2e-55df-46c3-8bb2-3f33f2ee2a58 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:51.073191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 507/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:51.075781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b2c92-d121-42dc-9e7a-f3c25ed98b65 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:51.176525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b2c92-d121-42dc-9e7a-f3c25ed98b65 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:51.196633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:51.212215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36a211-6146-4d80-998c-adc41ce1495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:51.212811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36a211-6146-4d80-998c-adc41ce1495b None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:51.213085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36a211-6146-4d80-998c-adc41ce1495b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:51.213379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36a211-6146-4d80-998c-adc41ce1495b None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:51.214023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36a211-6146-4d80-998c-adc41ce1495b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:51.215432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36a211-6146-4d80-998c-adc41ce1495b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:51.241192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 517/1024] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:43:51 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:51.929947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0206e2-1028-4184-a085-3f8ae1775f54 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:51.930454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0206e2-1028-4184-a085-3f8ae1775f54 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:51.930454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0206e2-1028-4184-a085-3f8ae1775f54 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:51.931777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 508/1025] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:51.936888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b64f-862c-4096-9f33-9e266110987e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:51.937189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b64f-862c-4096-9f33-9e266110987e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:51.937474 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211b64f-862c-4096-9f33-9e266110987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:51.956997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7211b64f-862c-4096-9f33-9e266110987e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:51.958216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7211b64f-862c-4096-9f33-9e266110987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:52.026575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 518/1026] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:52.294408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0206e2-1028-4184-a085-3f8ae1775f54 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:52.343514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a7cd-3613-4954-abb4-2c6ecc7b54ef None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.344027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a7cd-3613-4954-abb4-2c6ecc7b54ef None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.344133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a7cd-3613-4954-abb4-2c6ecc7b54ef None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.345542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 519/1027] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:43:52.350985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c9d03-28dd-4326-a079-4ee4a21727b1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.351269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c9d03-28dd-4326-a079-4ee4a21727b1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.351567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c9d03-28dd-4326-a079-4ee4a21727b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.369364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-cd4c9d03-28dd-4326-a079-4ee4a21727b1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:52.370549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cd4c9d03-28dd-4326-a079-4ee4a21727b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:52.393325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:52.402021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0206e2-1028-4184-a085-3f8ae1775f54 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:52.436475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:52.437103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.437422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.437695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] PATH_INFO: `/v3/services/image` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.438276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:52.440388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:52.444079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 520/1028] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:52.449424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:52.450392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:52.451212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:52.453438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 509/1029] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:52.456791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c9d03-28dd-4326-a079-4ee4a21727b1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:52.494188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:52.562075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c9d03-28dd-4326-a079-4ee4a21727b1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:52.598315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:52.598920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.599198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.599465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.600347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] RBAC: Adding query filter params (name=image) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:52.600646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:52.602018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:52.606979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 521/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:52.613320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:52.721571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05968d9a-2d98-4d67-a294-9c92b41731ee None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:52.726327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:52.759751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:52.760358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.760636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.760910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.761569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] RBAC: Adding query filter params (type=image) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:52.761867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:52.763234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:52.768178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 510/1031] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:52.773800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:52.799219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:52.836978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:52.840621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdb7cd-47a7-44a3-9c80-d45690355e6c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:52.881505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af14270-14a7-4c41-9dd6-f4e59bd0dfde None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:52.882148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:52.882776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.883160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.883317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.893913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:52.898877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:52.899964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:52.900815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 522/1032] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:52.905726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:52.921894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:52.922497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.922771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.923036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.923797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] RBAC: Adding query filter params (interface=public, service_id=aa23a8078f724476a95484da4b6bd61a, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:52.924769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:52.926164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:52.931683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 511/1033] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/endpoints?service_id=aa23a8078f724476a95484da4b6bd61a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:52.936897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:53.020509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577312e-821a-40c8-bf72-2ebcb3efd854 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:53.028332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:53.046358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea190415-ee0b-4483-a12e-82b1f9ae3548 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:53.058134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:53.058749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.059027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.059299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.059969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:53.060271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:53.061665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:53.070243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 523/1034] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:53.076376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:53.087662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:53.088204 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.088479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.088751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.089392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:53.090748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:53.097952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 512/1035] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:43:53.107346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:53.195104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b76f4-68a5-4e9f-93d7-5bb4443241b5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:53.231303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:53.231942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.232217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.232489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.244964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:53.246449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:53.261810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:53.262838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:53.263712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:53.263712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:53.263712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:53.265558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 524/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:53.269272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:53.380366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a4b-fce8-44d0-893e-7878fc975d00 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:53.415267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3f285-dc9d-402e-996d-4ad007cd467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:53.415875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3f285-dc9d-402e-996d-4ad007cd467d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.416151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3f285-dc9d-402e-996d-4ad007cd467d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.416421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3f285-dc9d-402e-996d-4ad007cd467d None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.417063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3f285-dc9d-402e-996d-4ad007cd467d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:53.417394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3f285-dc9d-402e-996d-4ad007cd467d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:53.418750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3f285-dc9d-402e-996d-4ad007cd467d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:53.434717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 513/1037] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:53.435899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:53.457686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51fea6-2475-424a-9c91-5bd1e64bcb63 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.457998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51fea6-2475-424a-9c91-5bd1e64bcb63 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.458235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51fea6-2475-424a-9c91-5bd1e64bcb63 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.459701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 514/1038] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:53.464470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c955-cb00-4639-93e9-a1cec785b93d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.464765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c955-cb00-4639-93e9-a1cec785b93d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.465029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243c955-cb00-4639-93e9-a1cec785b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.487492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a243c955-cb00-4639-93e9-a1cec785b93d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:53.488688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a243c955-cb00-4639-93e9-a1cec785b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:53.497015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:53.522555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:53.551421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44a47a-f76c-4419-8339-b7a44b937d43 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:53.562400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 515/1039] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:53.587320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:53.587953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.588230 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.588500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.596894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:53.598343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:53.609678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:53.610603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:53.617444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 525/1040] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:43:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:53.618064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c955-cb00-4639-93e9-a1cec785b93d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:53.725496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243c955-cb00-4639-93e9-a1cec785b93d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:53.760314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:53.760923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.761228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.761504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.762237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:53.762542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:53.763954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:53.779349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:53.788691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 516/1041] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:43:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:53.789975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:53.851411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:53.901588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980345f5-9880-44fd-a521-81b12f9c0d21 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:53.939879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:53.940835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:53.941421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:53.941715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:53.944706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:53.964211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45c61-2991-41ea-9f0f-4a6a24683a6c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.006672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.007321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.007595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.007866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.019078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:54.021746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.023201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:54.024516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:54.025453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:54.026298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 517/1042] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:54.031589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.093996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.141471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 526/1043] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:43:54.141662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4776a1f-8427-46d4-857a-7fb2ccea534b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.144363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.178289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.178995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.179277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.179549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.180203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:54.180507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.181897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.182810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.193264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 518/1044] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:54.195876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.259333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0323f28-9735-4eb1-a213-f8f0306da53e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.295470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d48882-0995-4ab6-9aa1-d25df5dc1099 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.299867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.300791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.301240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.301647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.312846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.314370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.320706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:54.330608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:54.331680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:54.337558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:54.337558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:54.337558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:54.337558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 527/1045] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:54.337558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.340307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.341017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.341324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.341593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] PATH_INFO: `/v3/users/c393d95a66c64824afe3954472136d76` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.357538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c393d95a66c64824afe3954472136d76)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.358975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.360731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 519/1046] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/users/c393d95a66c64824afe3954472136d76 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:54.366329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.430055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.446028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac2b0b-9253-4174-9ba6-0ac5f87580ef None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.473465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066657-b46b-4e44-a30c-c7bbbadda6f9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.481653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.482258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.482535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.482808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.483809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:54.484110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.485808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.502673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 528/1047] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:54.503728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.511807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.512417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.512695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.512966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.563358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.585012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.586621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.608772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f866e2-50bb-4a6d-b78f-2a6464d5844b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.646130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.647030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.647523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.647952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.661804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.663256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:54.675374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:54.676448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:54.677406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 529/1048] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:54.681992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.691258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.703368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 520/1049] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:43:54.709753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.789723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2dba5-ff76-4d44-be59-0fc98c064537 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.793517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.816910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dddbf0-84b1-4d8b-8fbc-d6b299e011ea None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.831073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.831853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.832134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.832801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.833597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:54.833905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.835318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.855251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 530/1050] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:54.856595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.859544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:54.861039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:54.861861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:54.862129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:54.863322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] RBAC: Authorizing `identity:get_project(project_id=15715c7c37174d548a15eb50057ac60d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:54.864741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:54.871884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 521/1051] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/projects/15715c7c37174d548a15eb50057ac60d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:54.873054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:54.926556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:54.966463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d036199-6de4-416c-867f-fa5eb0f24a14 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:54.982858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad145912-165f-4e29-b6e3-275937821086 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:55.005013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f981af-bd6c-4da3-97dc-214f2db276a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:55.005909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f981af-bd6c-4da3-97dc-214f2db276a9 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:55.006182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f981af-bd6c-4da3-97dc-214f2db276a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:55.006455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f981af-bd6c-4da3-97dc-214f2db276a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:55.007193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f981af-bd6c-4da3-97dc-214f2db276a9 None admin] RBAC: Adding query filter params (role.id=96d8c1e75df54378a1f5ee790a6d1d6d, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=84d136bca97e446a888c1b51a5b761a2) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:55.007502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f981af-bd6c-4da3-97dc-214f2db276a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:55.008919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f981af-bd6c-4da3-97dc-214f2db276a9 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:55.017180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 531/1052] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/role_assignments?user.id=84d136bca97e446a888c1b51a5b761a2&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=96d8c1e75df54378a1f5ee790a6d1d6d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:55.034070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b56c1-f9dc-488e-850c-a35cb21ce0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:55.034823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b56c1-f9dc-488e-850c-a35cb21ce0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:55.035164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b56c1-f9dc-488e-850c-a35cb21ce0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:55.035502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b56c1-f9dc-488e-850c-a35cb21ce0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:55.036330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b56c1-f9dc-488e-850c-a35cb21ce0d0 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=15715c7c37174d548a15eb50057ac60d, user.id=c393d95a66c64824afe3954472136d76) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:55.036703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b56c1-f9dc-488e-850c-a35cb21ce0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:55.038284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b56c1-f9dc-488e-850c-a35cb21ce0d0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:55.053270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 522/1053] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:43:54 2022] GET /identity/v3/role_assignments?user.id=c393d95a66c64824afe3954472136d76&scope.project.id=15715c7c37174d548a15eb50057ac60d&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:55.299741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea526a8-5a88-474b-bd84-cd7bde021454 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:55.300130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea526a8-5a88-474b-bd84-cd7bde021454 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:55.300260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea526a8-5a88-474b-bd84-cd7bde021454 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:55.301636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 532/1054] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:55.306994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f065ad-73f7-4eec-8ad2-52d5516d6941 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:55.307280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f065ad-73f7-4eec-8ad2-52d5516d6941 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:55.307557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f065ad-73f7-4eec-8ad2-52d5516d6941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:55.326603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-33f065ad-73f7-4eec-8ad2-52d5516d6941 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:55.327794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-33f065ad-73f7-4eec-8ad2-52d5516d6941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:55.335616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:55.399136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 523/1055] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:55.668738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea526a8-5a88-474b-bd84-cd7bde021454 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:55.775240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea526a8-5a88-474b-bd84-cd7bde021454 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:55.811935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:55.819947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:55.820580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:55.820855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:55.821122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] PATH_INFO: `/v3/services/image` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:55.821731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:55.823086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:55.839270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:55.840314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:43:55.841701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:55.845465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 533/1056] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Sep 19 11:43:55 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:55.847918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f065ad-73f7-4eec-8ad2-52d5516d6941 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:55.952512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f065ad-73f7-4eec-8ad2-52d5516d6941 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:55.987133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:55.987768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:55.987984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:55.988312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:55.988938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] RBAC: Adding query filter params (name=image) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:55.989260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:55.990615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:55.999874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 524/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:56.001074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:56.102500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ad268-ece7-4b7f-bfa2-26d43b62e9ee None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:56.135409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99a37-600e-4542-b3f9-a8f3dfa63760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:56.135993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99a37-600e-4542-b3f9-a8f3dfa63760 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:56.136266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99a37-600e-4542-b3f9-a8f3dfa63760 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:56.136535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99a37-600e-4542-b3f9-a8f3dfa63760 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:56.137184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99a37-600e-4542-b3f9-a8f3dfa63760 None admin] RBAC: Adding query filter params (type=image) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:56.137478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99a37-600e-4542-b3f9-a8f3dfa63760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:56.138820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99a37-600e-4542-b3f9-a8f3dfa63760 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:56.144490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 534/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:56.149961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:56.159425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:56.254921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425be2c0-0fa1-4aeb-970e-9949ec664a59 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:56.290460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6185-faf0-4112-8230-947650adf473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:56.291067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6185-faf0-4112-8230-947650adf473 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:56.291339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6185-faf0-4112-8230-947650adf473 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:56.291602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6185-faf0-4112-8230-947650adf473 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:56.292272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6185-faf0-4112-8230-947650adf473 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:56.293669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6185-faf0-4112-8230-947650adf473 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:56.315352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 525/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:43:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:43:57.216605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714afa2c-9428-4288-a63f-89223ff1cc71 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:57.217129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714afa2c-9428-4288-a63f-89223ff1cc71 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:57.217129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714afa2c-9428-4288-a63f-89223ff1cc71 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:57.218677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 535/1060] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:57.223733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba9f2-e2c6-4d99-97b6-7f4f44d75121 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:57.224114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba9f2-e2c6-4d99-97b6-7f4f44d75121 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:57.224288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba9f2-e2c6-4d99-97b6-7f4f44d75121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:57.243418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-46bba9f2-e2c6-4d99-97b6-7f4f44d75121 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:57.244626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-46bba9f2-e2c6-4d99-97b6-7f4f44d75121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:57.304020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:57.329294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 526/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:57.506322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2f8d-c479-45dd-9fab-347bf542bce8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:57.506513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2f8d-c479-45dd-9fab-347bf542bce8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:57.506773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2f8d-c479-45dd-9fab-347bf542bce8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:57.508312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 536/1062] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:43:57.513771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35e1d5-32ce-4a03-a5f0-68dab16b1e9a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:57.514068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35e1d5-32ce-4a03-a5f0-68dab16b1e9a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:57.514318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35e1d5-32ce-4a03-a5f0-68dab16b1e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:57.534030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3a35e1d5-32ce-4a03-a5f0-68dab16b1e9a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:57.535439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3a35e1d5-32ce-4a03-a5f0-68dab16b1e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:57.593084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2f8d-c479-45dd-9fab-347bf542bce8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:57.605551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 527/1063] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:43:57.662351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:57.707025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2f8d-c479-45dd-9fab-347bf542bce8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:57.741419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:57.742038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:57.742311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:57.742576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:57.752707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:57.757511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:57.758417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:57.759835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 537/1064] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:57.769077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35e1d5-32ce-4a03-a5f0-68dab16b1e9a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:57.873681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35e1d5-32ce-4a03-a5f0-68dab16b1e9a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:57.880385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:57.893623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:57.913195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:57.913804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:57.914089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:57.914359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:57.915035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:57.915338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:57.916695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:57.929186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 528/1065] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:57.931540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:57.997592 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48167a62-d1e4-4b0e-9aca-232ea59d04cc None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.019267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:58.033375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1b68b-f21c-4c6a-bdf3-cd1292f5c216 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.040123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.040749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.041027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.041328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.053542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:43:58.059621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:58.060562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:58.061440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 538/1066] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Sep 19 11:43:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:58.066561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:58.070083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.070714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.070996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.071275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] PATH_INFO: `/v3/users/c393d95a66c64824afe3954472136d76` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.072414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] RBAC: Authorizing `identity:get_user(user_id=c393d95a66c64824afe3954472136d76)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.073936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.075815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 529/1067] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:43:57 2022] GET /identity/v3/users/c393d95a66c64824afe3954472136d76 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:58.081022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:58.132718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:58.177200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886063a-1a8b-44a3-83ab-46bbe3ca804d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.185063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b666c-2df6-4408-ba4e-eabf07a1345a None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.214545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.215167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.215471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.215740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.216398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:58.216736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.218116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.220320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.221486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.221766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.222037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.223162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] RBAC: Authorizing `identity:get_project(project_id=15715c7c37174d548a15eb50057ac60d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.224564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.233360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 530/1068] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:43:58 2022] GET /identity/v3/projects/15715c7c37174d548a15eb50057ac60d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:58.233501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 539/1069] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Sep 19 11:43:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:58.233603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:58.234855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:58.279967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:58.339557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4666c-b3e9-470f-b4ba-e049c416e0e9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.342747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d633be-645b-469f-9156-3770f9a10ea7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.357928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:58.378538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.379198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.379479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.379656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.379784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d/users/c393d95a66c64824afe3954472136d76/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.380255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.380533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.380804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.381719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] RBAC: Authorizing `identity:create_grant(project_id=15715c7c37174d548a15eb50057ac60d, user_id=c393d95a66c64824afe3954472136d76, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.383156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.392729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.394508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.405182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 531/1070] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:43:58 2022] PUT /identity/v3/projects/15715c7c37174d548a15eb50057ac60d/users/c393d95a66c64824afe3954472136d76/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:58.409977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:58.411033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:58.412486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:58.412486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:58.412486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:58.412486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 540/1071] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:58.417083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:58.529070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c526-92cd-4257-96dc-3fda3f3e3abf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.570255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.570895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.571814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.571814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.572081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:58.573260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.573784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.589562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 532/1072] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:58.595266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:58.701269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:58.712060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491bb8-4925-40c1-8d41-576fcf94a094 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.750529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37c0de-240b-4049-a79d-6a1e25f62729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.751323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c0de-240b-4049-a79d-6a1e25f62729 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.751748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c0de-240b-4049-a79d-6a1e25f62729 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.752212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c0de-240b-4049-a79d-6a1e25f62729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.760197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c0de-240b-4049-a79d-6a1e25f62729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.761763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c0de-240b-4049-a79d-6a1e25f62729 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6c37c0de-240b-4049-a79d-6a1e25f62729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:43:58.773796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:58.774995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:43:58.776247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:58.782485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 541/1073] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:43:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:58.784287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:58.820495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:58.827615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b653-fea2-4bb1-9839-d6f0d1bf291e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.827894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b653-fea2-4bb1-9839-d6f0d1bf291e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.828166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b653-fea2-4bb1-9839-d6f0d1bf291e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.829677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 542/1074] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:43:58.836597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5de8-6e6d-4982-9fb1-4f98bd4cae8f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.836869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5de8-6e6d-4982-9fb1-4f98bd4cae8f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.837134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5de8-6e6d-4982-9fb1-4f98bd4cae8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.856427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-46aa5de8-6e6d-4982-9fb1-4f98bd4cae8f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:58.857670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-46aa5de8-6e6d-4982-9fb1-4f98bd4cae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:58.896056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de5bde-3c07-4d40-937b-30ba89892c2e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:58.931254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 543/1075] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:43:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:43:58.933139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:58.933772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:58.934050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:58.934320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:58.935053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:58.935354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:58.936766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:58.960209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 533/1076] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:43:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:58.961408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa5de8-6e6d-4982-9fb1-4f98bd4cae8f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.043302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.062487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa5de8-6e6d-4982-9fb1-4f98bd4cae8f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.097414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.097967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.098241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.098507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.108884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.110386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:59.124843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:59.126046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:59.128110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:59.128110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:59.128110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:59.128110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 544/1077] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:59.132276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.204364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.229582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.239243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531f6e-cd45-4340-8f62-6266dbf3258f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.275109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.275711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.275987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.276246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.276887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:59.277213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.278566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.294448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 534/1078] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:43:59.295672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.322074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341c5b7-ed12-4c4e-b463-61538236e085 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.364367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.364885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.365300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.365568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.368141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.402039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc192705-b7d3-47fe-b8f5-f7dffa6dece4 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.436643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.437296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.437571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.437860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.445035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.446507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.447172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.448989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:43:59.458125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:59.459111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:43:59.460053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 535/1079] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:43:59.464854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.481947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.565301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 545/1080] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:43:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:43:59.570745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.577206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb40cd-a8d8-4828-ab8c-41831e9301b8 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.606268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.614351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.615013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.615248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.615548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.616248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:59.616554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.618020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.631051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 536/1081] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:43:59.636859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.683304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c2d2-aaa9-4735-ab28-a13e4ef3542c None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.719786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.720410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.721345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.721633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.731186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.732441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.734013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:43:59.750108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:43:59.751562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:43:59.753419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:43:59.753419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:43:59.753419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:43:59.753419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 546/1082] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:43:59.758846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:59.762980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f44b-8304-45b4-9acf-69e27165db5d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.800867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a91e6-ee96-4637-95d8-dd9ce2b91c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.801581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a91e6-ee96-4637-95d8-dd9ce2b91c48 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.801861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a91e6-ee96-4637-95d8-dd9ce2b91c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.802149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a91e6-ee96-4637-95d8-dd9ce2b91c48 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/84d136bca97e446a888c1b51a5b761a2/roles/96d8c1e75df54378a1f5ee790a6d1d6d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.804310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a91e6-ee96-4637-95d8-dd9ce2b91c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=84d136bca97e446a888c1b51a5b761a2, role_id=96d8c1e75df54378a1f5ee790a6d1d6d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.805814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a91e6-ee96-4637-95d8-dd9ce2b91c48 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.819871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 537/1083] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:43:59 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/84d136bca97e446a888c1b51a5b761a2/roles/96d8c1e75df54378a1f5ee790a6d1d6d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:43:59.857044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.876552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4315e-6e10-4c46-a965-0ac0ac2cdcde None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:59.920457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e707-45d5-4462-b6c3-6c5a6480b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:59.921085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e707-45d5-4462-b6c3-6c5a6480b689 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:59.921395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e707-45d5-4462-b6c3-6c5a6480b689 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:59.921669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e707-45d5-4462-b6c3-6c5a6480b689 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:59.922357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e707-45d5-4462-b6c3-6c5a6480b689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:43:59.922660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e707-45d5-4462-b6c3-6c5a6480b689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:59.924665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e707-45d5-4462-b6c3-6c5a6480b689 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:59.938656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 547/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:44:00.723278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e7aa-2c66-4e8e-a957-a510574242b1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:00.723838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e7aa-2c66-4e8e-a957-a510574242b1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:00.724092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e7aa-2c66-4e8e-a957-a510574242b1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:00.725736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 538/1085] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:00.731085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd99b1-e146-4906-936e-c67a5f49de7d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:00.731532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd99b1-e146-4906-936e-c67a5f49de7d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:00.731624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd99b1-e146-4906-936e-c67a5f49de7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:00.753055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d1bd99b1-e146-4906-936e-c67a5f49de7d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:00.754464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d1bd99b1-e146-4906-936e-c67a5f49de7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:00.832453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 548/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:01.148912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819e7aa-2c66-4e8e-a957-a510574242b1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:01.276322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819e7aa-2c66-4e8e-a957-a510574242b1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:01.319130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:01.319711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:01.319985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:01.320251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:01.322117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:01.331893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:01.336860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:01.337831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:44:01.338710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 539/1087] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:01.344187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd99b1-e146-4906-936e-c67a5f49de7d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:01.426107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:01.448401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd99b1-e146-4906-936e-c67a5f49de7d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:01.482438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:01.483040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:01.483314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:01.483584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:01.484245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:01.484543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:01.485925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:01.493819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 549/1088] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:01.499713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:01.598568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8edaa8-0957-4725-920b-27e4d29b6457 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:01.634713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:01.635345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:01.635625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:01.635902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] PATH_INFO: `/v3/users/c393d95a66c64824afe3954472136d76` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:01.637026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] RBAC: Authorizing `identity:get_user(user_id=c393d95a66c64824afe3954472136d76)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:01.638557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:01.640133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 540/1089] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:01 2022] GET /identity/v3/users/c393d95a66c64824afe3954472136d76 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:44:01.646817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:01.746723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18935a5b-003a-4087-b34f-327902da72ce None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:01.779944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:01.780537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:01.780811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:01.781077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:01.790356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:01.848814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:01.850545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:01.948047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 550/1090] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:01.954000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:02.018607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:02.057347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca1327-0c7b-48b1-bf14-5ad4bded05ef None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:02.092967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c35deb-f344-4af5-8c81-86b1115df913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:02.093623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35deb-f344-4af5-8c81-86b1115df913 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:02.093904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35deb-f344-4af5-8c81-86b1115df913 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:02.094179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35deb-f344-4af5-8c81-86b1115df913 None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:02.095305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c35deb-f344-4af5-8c81-86b1115df913 None admin] RBAC: Authorizing `identity:get_project(project_id=15715c7c37174d548a15eb50057ac60d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:02.096858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c35deb-f344-4af5-8c81-86b1115df913 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:02.098524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 541/1091] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:01 2022] GET /identity/v3/projects/15715c7c37174d548a15eb50057ac60d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:02.104832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:02.112484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a8cd-ad0b-474f-bec8-ff824da348c0 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:02.112763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a8cd-ad0b-474f-bec8-ff824da348c0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:02.113041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a8cd-ad0b-474f-bec8-ff824da348c0 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:02.114377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 542/1092] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:44:02.119445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b119-a29c-454a-a029-a5b4ac2c14b0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:02.119729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b119-a29c-454a-a029-a5b4ac2c14b0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:02.120008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b119-a29c-454a-a029-a5b4ac2c14b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:02.138274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8af2b119-a29c-454a-a029-a5b4ac2c14b0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:02.139465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8af2b119-a29c-454a-a029-a5b4ac2c14b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:02.147563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:02.206659 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 543/1093] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:44:02.206880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e2b2-e450-4ee3-ad13-3aaff951622b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:02.240870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:02.241506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:02.241786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:02.242057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:02.242780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=15715c7c37174d548a15eb50057ac60d, user.id=c393d95a66c64824afe3954472136d76) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:02.243088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:02.244506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:02.261186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 551/1094] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:02 2022] GET /identity/v3/role_assignments?user.id=c393d95a66c64824afe3954472136d76&scope.project.id=15715c7c37174d548a15eb50057ac60d&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:44:02.479000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2b119-a29c-454a-a029-a5b4ac2c14b0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:02.537071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:02.577842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2b119-a29c-454a-a029-a5b4ac2c14b0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:02.611883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:02.612509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:02.612786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:02.613059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:02.622945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:02.627765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:02.628701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:44:02.629611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 544/1095] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Sep 19 11:44:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:02.634999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:02.738823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda144-e7d0-4f49-bb9d-ca43bee0210e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:02.740290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:02.776127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:02.776773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:02.777000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:02.777305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:02.777964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:02.778263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:02.779608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:02.789237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 552/1096] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Sep 19 11:44:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:02.795095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:02.893066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182905-13f7-491e-a512-663cb5ba7ca1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:02.913216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:02.927566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:02.928189 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:02.928468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:02.928743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:02.938566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:02.940526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:44:02.955389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:02.957110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:44:02.958032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:44:02.958032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:44:02.958032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:44:02.958032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 545/1097] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:02.962259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:03.060070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0bca8-60fd-4cd7-80e5-a09cced267b1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:03.093635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:03.094260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:03.094535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:03.094803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:03.095439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:03.095733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:03.097080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:03.108366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 553/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:44:03.115291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:03.216153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1589-e715-455a-b8b4-20eb4347d16b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:03.248934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:03.249566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:03.249838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:03.250104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:03.258029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:03.259444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:44:03.270502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:03.271612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:44:03.272544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 546/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Sep 19 11:44:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:03.277471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:03.302899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:03.376484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234231d-02c8-4a77-9cdf-a3935709db0a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:03.409019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:03.409641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:03.409917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:03.410182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:03.410901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:03.411201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:03.412599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:03.434588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 554/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Sep 19 11:44:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:03.435782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:03.466661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:03.535990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5afaf-9448-4d8c-806a-d5df00061c2b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:03.568800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:03.569422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:03.569698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:03.569964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:03.635543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:03.636905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:03.669445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:03.737651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 547/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:03.743375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:03.823723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:03.842210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c1882-5bdd-4f49-8d9b-3a90e0547bfd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:03.876182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:03.877405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:03.877685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:03.877981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:03.887859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:03.889252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:44:03.903888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:03.904977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:44:03.906098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:44:03.906098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:44:03.906098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:03.906098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 555/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:03.911069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:04.009365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155719c1-b5ee-4124-addf-e3b004bd2761 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:04.037887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:04.043479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:04.044080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:04.044353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:04.044620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:04.045296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:04.045595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:04.046941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:04.058957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 548/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:04.065234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:04.163999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bb52f-f143-4a6f-a460-3687354a03bd None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:04.198355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:04.198978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:04.199251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:04.199523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:04.201401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:04.207438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:04.208863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:44:04.220014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:04.221526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:04.222436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 556/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:44:04.227819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:04.327666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f6af9-8f1d-4462-8b6b-0e449f96dff9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:04.364844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d63d-2c02-4b8e-9d3c-ad238efabcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:04.365481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d63d-2c02-4b8e-9d3c-ad238efabcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:04.365760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d63d-2c02-4b8e-9d3c-ad238efabcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:04.366032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d63d-2c02-4b8e-9d3c-ad238efabcc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:04.366726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d63d-2c02-4b8e-9d3c-ad238efabcc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:04.367030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d63d-2c02-4b8e-9d3c-ad238efabcc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:04.368448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d63d-2c02-4b8e-9d3c-ad238efabcc1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:04.380435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 549/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:04.386462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:04.436390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b401d0-873c-4694-9e94-6cd3cffb59f8 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:04.436619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b401d0-873c-4694-9e94-6cd3cffb59f8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:04.436900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b401d0-873c-4694-9e94-6cd3cffb59f8 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:04.438266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 550/1106] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:44:04.443549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce841e8-2e67-4e30-b93e-90f08429cc30 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:04.443823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce841e8-2e67-4e30-b93e-90f08429cc30 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:04.444089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce841e8-2e67-4e30-b93e-90f08429cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:04.463891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9ce841e8-2e67-4e30-b93e-90f08429cc30 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:04.465070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9ce841e8-2e67-4e30-b93e-90f08429cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:04.489725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5f4a-2b8f-4a2d-a5c5-e0ce95ab84df None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:04.516698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:04.523280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:04.523879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:04.524154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:04.524428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:04.525142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] RBAC: Adding query filter params (role.id=96d8c1e75df54378a1f5ee790a6d1d6d, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=84d136bca97e446a888c1b51a5b761a2) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:04.525470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:04.526875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:04.532677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 557/1107] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:04 2022] GET /identity/v3/role_assignments?user.id=84d136bca97e446a888c1b51a5b761a2&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=96d8c1e75df54378a1f5ee790a6d1d6d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:04.539023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 551/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:44:04.811668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:04.872069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:04.916151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449248c8-a614-4e5e-ae96-6fa91c7fc953 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:04.949832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426a5ee-617a-49b3-b7e7-b3f92a78ebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:04.950454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a5ee-617a-49b3-b7e7-b3f92a78ebf0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:04.950729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a5ee-617a-49b3-b7e7-b3f92a78ebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:04.950997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426a5ee-617a-49b3-b7e7-b3f92a78ebf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:04.952091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426a5ee-617a-49b3-b7e7-b3f92a78ebf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:04.953542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426a5ee-617a-49b3-b7e7-b3f92a78ebf0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:04.955653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 558/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:04.961650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce841e8-2e67-4e30-b93e-90f08429cc30 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:05.067744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce841e8-2e67-4e30-b93e-90f08429cc30 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:05.102418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ac3f5-f551-4472-b561-80eb3a6e1ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:05.103029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac3f5-f551-4472-b561-80eb3a6e1ec4 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:05.103308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac3f5-f551-4472-b561-80eb3a6e1ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:05.103585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ac3f5-f551-4472-b561-80eb3a6e1ec4 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:05.104241 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ac3f5-f551-4472-b561-80eb3a6e1ec4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:05.105704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ac3f5-f551-4472-b561-80eb3a6e1ec4 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:05.128034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 552/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:44:04 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:07.323918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31ae3-0d7c-4e53-ae1b-35262a179e81 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:07.324454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31ae3-0d7c-4e53-ae1b-35262a179e81 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:07.324454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31ae3-0d7c-4e53-ae1b-35262a179e81 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:07.325905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 559/1111] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:44:07.332152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce3c5-b826-4a90-9c55-20747f66c8e2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:07.332629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce3c5-b826-4a90-9c55-20747f66c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:07.332765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ce3c5-b826-4a90-9c55-20747f66c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:07.351472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c83ce3c5-b826-4a90-9c55-20747f66c8e2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:07.352651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c83ce3c5-b826-4a90-9c55-20747f66c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:07.381415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:07.419110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 553/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:07.688730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b31ae3-0d7c-4e53-ae1b-35262a179e81 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:07.788388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b31ae3-0d7c-4e53-ae1b-35262a179e81 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:07.813010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:07.822274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:07.822889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:07.823163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:07.823432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] PATH_INFO: `/v3/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:07.824802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] RBAC: Authorizing `identity:get_role(role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:07.826187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:07.827480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 560/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:07 2022] GET /identity/v3/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:07.833937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ce3c5-b826-4a90-9c55-20747f66c8e2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:07.929360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ce3c5-b826-4a90-9c55-20747f66c8e2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:07.962379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:07.962997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:07.963335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:07.963547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] PATH_INFO: `/v3/users/7c824a8175c846d0809122ac1cd4fda8` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:07.976751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] RBAC: Authorizing `identity:get_user(user_id=7c824a8175c846d0809122ac1cd4fda8)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:07.978209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:07.979907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 554/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:07 2022] GET /identity/v3/users/7c824a8175c846d0809122ac1cd4fda8 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:07.985625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:08.087787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f4ee8-3087-4e52-8db7-092888bcb27e None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:08.121831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:08.122437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:08.122717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:08.122990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:08.184138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:08.193031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:08.194513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:08.292201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 561/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:08.298123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:08.326199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:08.397658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6106-7da6-4bc8-902b-00bc9e5a5a33 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:08.431048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1899ca-96e3-4c11-8306-aa9771517c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:08.431662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1899ca-96e3-4c11-8306-aa9771517c40 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:08.431942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1899ca-96e3-4c11-8306-aa9771517c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:08.432216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1899ca-96e3-4c11-8306-aa9771517c40 None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:08.433353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1899ca-96e3-4c11-8306-aa9771517c40 None admin] RBAC: Authorizing `identity:get_project(project_id=15715c7c37174d548a15eb50057ac60d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:08.434824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1899ca-96e3-4c11-8306-aa9771517c40 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:08.436375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 555/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:08 2022] GET /identity/v3/projects/15715c7c37174d548a15eb50057ac60d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:08.443233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:08.534574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:08.541484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801b73-3836-4ae9-bb48-b0866480f02f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:08.574814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44b9f-a4a6-4a1f-8840-d5d5d2156691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:08.575410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44b9f-a4a6-4a1f-8840-d5d5d2156691 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:08.575703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44b9f-a4a6-4a1f-8840-d5d5d2156691 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:08.575973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44b9f-a4a6-4a1f-8840-d5d5d2156691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:08.576689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44b9f-a4a6-4a1f-8840-d5d5d2156691 None admin] RBAC: Adding query filter params (role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=15715c7c37174d548a15eb50057ac60d, user.id=7c824a8175c846d0809122ac1cd4fda8) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:08.576991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44b9f-a4a6-4a1f-8840-d5d5d2156691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:08.578423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44b9f-a4a6-4a1f-8840-d5d5d2156691 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:08.583834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 562/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:08 2022] GET /identity/v3/role_assignments?user.id=7c824a8175c846d0809122ac1cd4fda8&scope.project.id=15715c7c37174d548a15eb50057ac60d&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:10.688023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46bd0f-4bb6-4f57-aca9-a1d79a542f8c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:10.688472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46bd0f-4bb6-4f57-aca9-a1d79a542f8c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:10.688557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46bd0f-4bb6-4f57-aca9-a1d79a542f8c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:10.690193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 556/1118] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:10.695304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f28ed7-64b8-4b6f-8c06-105193918331 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:10.695698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f28ed7-64b8-4b6f-8c06-105193918331 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:10.695843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f28ed7-64b8-4b6f-8c06-105193918331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:10.714110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a1f28ed7-64b8-4b6f-8c06-105193918331 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:10.715278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a1f28ed7-64b8-4b6f-8c06-105193918331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:10.781660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 563/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:11.051272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46bd0f-4bb6-4f57-aca9-a1d79a542f8c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:11.143110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:11.150850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46bd0f-4bb6-4f57-aca9-a1d79a542f8c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:11.184511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:11.185122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:11.185431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:11.185702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] PATH_INFO: `/v3/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:11.187066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] RBAC: Authorizing `identity:get_role(role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:11.188421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:11.189832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 557/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:11 2022] GET /identity/v3/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:11.195559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f28ed7-64b8-4b6f-8c06-105193918331 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:11.280562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:11.293286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f28ed7-64b8-4b6f-8c06-105193918331 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:11.325982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:11.326605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:11.326882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:11.327153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] PATH_INFO: `/v3/users/7c824a8175c846d0809122ac1cd4fda8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:11.328289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] RBAC: Authorizing `identity:get_user(user_id=7c824a8175c846d0809122ac1cd4fda8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:11.330279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:11.331834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 564/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:11 2022] GET /identity/v3/users/7c824a8175c846d0809122ac1cd4fda8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:11.337541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:11.433368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62761e-7c53-4307-8173-0d553b9c2334 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:11.466108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428457-cf5a-4378-8942-ea332c9e528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:11.466717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428457-cf5a-4378-8942-ea332c9e528f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:11.466995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428457-cf5a-4378-8942-ea332c9e528f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:11.467281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428457-cf5a-4378-8942-ea332c9e528f None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:11.468369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428457-cf5a-4378-8942-ea332c9e528f None admin] RBAC: Authorizing `identity:get_project(project_id=15715c7c37174d548a15eb50057ac60d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:11.469814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428457-cf5a-4378-8942-ea332c9e528f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:11.472061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 558/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:11 2022] GET /identity/v3/projects/15715c7c37174d548a15eb50057ac60d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:11.478179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:11.575289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f165414-17d0-4378-84a5-975f5149067a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:11.608501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef69e7-39c9-47e5-a60d-b31c2b57a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:11.609080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef69e7-39c9-47e5-a60d-b31c2b57a286 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:11.609384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef69e7-39c9-47e5-a60d-b31c2b57a286 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:11.609657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef69e7-39c9-47e5-a60d-b31c2b57a286 None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d/users/7c824a8175c846d0809122ac1cd4fda8/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:11.611989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef69e7-39c9-47e5-a60d-b31c2b57a286 None admin] RBAC: Authorizing `identity:create_grant(project_id=15715c7c37174d548a15eb50057ac60d, user_id=7c824a8175c846d0809122ac1cd4fda8, role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:11.613435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef69e7-39c9-47e5-a60d-b31c2b57a286 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:11.625672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 565/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:44:11 2022] PUT /identity/v3/projects/15715c7c37174d548a15eb50057ac60d/users/7c824a8175c846d0809122ac1cd4fda8/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:13.757413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ed971-f6b5-4bfa-84a2-1f44c83ba393 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:13.757931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ed971-f6b5-4bfa-84a2-1f44c83ba393 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:13.757931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ed971-f6b5-4bfa-84a2-1f44c83ba393 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:13.759284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 559/1124] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:13.764415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a248f5-1ce4-4054-b2e4-3dbac6052f22 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:13.764787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a248f5-1ce4-4054-b2e4-3dbac6052f22 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:13.764958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a248f5-1ce4-4054-b2e4-3dbac6052f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:13.783831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-14a248f5-1ce4-4054-b2e4-3dbac6052f22 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:13.785012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-14a248f5-1ce4-4054-b2e4-3dbac6052f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:13.795502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:13.853093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 566/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:14.120479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ed971-f6b5-4bfa-84a2-1f44c83ba393 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:14.150861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:14.219749 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ed971-f6b5-4bfa-84a2-1f44c83ba393 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:14.252585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:14.253208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:14.253485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:14.253755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] PATH_INFO: `/v3/roles/c2161c30677647ec86d7e1d2214de7f6` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:14.255120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] RBAC: Authorizing `identity:get_role(role_id=c2161c30677647ec86d7e1d2214de7f6)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:14.256465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:14.257780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 560/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:14 2022] GET /identity/v3/roles/c2161c30677647ec86d7e1d2214de7f6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:14.263516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a248f5-1ce4-4054-b2e4-3dbac6052f22 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:14.360239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a248f5-1ce4-4054-b2e4-3dbac6052f22 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:14.393618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:14.394176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:14.394457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:14.394733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] PATH_INFO: `/v3/users/7c824a8175c846d0809122ac1cd4fda8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:14.395858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] RBAC: Authorizing `identity:get_user(user_id=7c824a8175c846d0809122ac1cd4fda8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:14.397309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:14.398857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 567/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:14 2022] GET /identity/v3/users/7c824a8175c846d0809122ac1cd4fda8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:14.404509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:14.497775 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:14.501528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb429965-8769-4a59-845b-72f6f5f8732e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:14.535678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:14.536301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:14.536580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:14.536849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:14.602561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:14.603981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:14.696057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:14.700943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 561/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:14.706917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:14.722908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:14.807497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5af1e-c77d-4fcd-89d7-6786237c25c0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:14.839789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f3ab6-0376-4e76-9961-61088a31f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:14.840412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f3ab6-0376-4e76-9961-61088a31f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:14.840691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f3ab6-0376-4e76-9961-61088a31f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:14.840964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f3ab6-0376-4e76-9961-61088a31f5e3 None admin] PATH_INFO: `/v3/projects/15715c7c37174d548a15eb50057ac60d` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:14.842095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f3ab6-0376-4e76-9961-61088a31f5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=15715c7c37174d548a15eb50057ac60d)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:14.843506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f3ab6-0376-4e76-9961-61088a31f5e3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:14.845102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 568/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:14 2022] GET /identity/v3/projects/15715c7c37174d548a15eb50057ac60d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:14.852123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:14.948048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47cb9f-db11-4d3e-b646-60e936654b0d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:14.981694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc9e31-ec5f-4933-bc70-b44e08c57ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:14.982279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9e31-ec5f-4933-bc70-b44e08c57ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:14.982554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9e31-ec5f-4933-bc70-b44e08c57ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:14.982824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9e31-ec5f-4933-bc70-b44e08c57ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:14.983540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc9e31-ec5f-4933-bc70-b44e08c57ff1 None admin] RBAC: Adding query filter params (role.id=c2161c30677647ec86d7e1d2214de7f6, scope.project.id=15715c7c37174d548a15eb50057ac60d, user.id=7c824a8175c846d0809122ac1cd4fda8) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:14.983844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc9e31-ec5f-4933-bc70-b44e08c57ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:14.985276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc9e31-ec5f-4933-bc70-b44e08c57ff1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:14.991043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 562/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:14 2022] GET /identity/v3/role_assignments?user.id=7c824a8175c846d0809122ac1cd4fda8&scope.project.id=15715c7c37174d548a15eb50057ac60d&role.id=c2161c30677647ec86d7e1d2214de7f6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:17.145744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39cfa-df26-4716-ba29-4e68bcb98c6a None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:17.146274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39cfa-df26-4716-ba29-4e68bcb98c6a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:17.146274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39cfa-df26-4716-ba29-4e68bcb98c6a None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:17.147612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 569/1131] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:17.152827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a128e6-7e05-4008-84ed-3efec23ad9b4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:17.153218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a128e6-7e05-4008-84ed-3efec23ad9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:17.153409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a128e6-7e05-4008-84ed-3efec23ad9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:17.171730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b6a128e6-7e05-4008-84ed-3efec23ad9b4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:17.172903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b6a128e6-7e05-4008-84ed-3efec23ad9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:17.227713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:17.238494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 563/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:17.508655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39cfa-df26-4716-ba29-4e68bcb98c6a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:17.589530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:17.608625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39cfa-df26-4716-ba29-4e68bcb98c6a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:17.641689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c473b-957c-4552-be80-2efb5514d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:17.642415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c473b-957c-4552-be80-2efb5514d63a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:17.642695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c473b-957c-4552-be80-2efb5514d63a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:17.642967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c473b-957c-4552-be80-2efb5514d63a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:17.644076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c473b-957c-4552-be80-2efb5514d63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:17.645521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c473b-957c-4552-be80-2efb5514d63a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:17.647063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 570/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:17.652876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a128e6-7e05-4008-84ed-3efec23ad9b4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:17.749719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a128e6-7e05-4008-84ed-3efec23ad9b4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:17.784077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef964-9d0f-4252-bf26-47cfd104e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:17.784610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef964-9d0f-4252-bf26-47cfd104e6ca None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:17.784887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef964-9d0f-4252-bf26-47cfd104e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:17.785183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef964-9d0f-4252-bf26-47cfd104e6ca None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:17.785827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ef964-9d0f-4252-bf26-47cfd104e6ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:17.787241 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ef964-9d0f-4252-bf26-47cfd104e6ca None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:17.813090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 564/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:44:17 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:19.967954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ec4f-d8d1-4fba-b8cb-06ea5483c6ad None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:19.968479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ec4f-d8d1-4fba-b8cb-06ea5483c6ad None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:19.968479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ec4f-d8d1-4fba-b8cb-06ea5483c6ad None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:19.969777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 571/1135] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:19.974958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5302-c884-4b63-afb6-0f74cfc93f37 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:19.975628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5302-c884-4b63-afb6-0f74cfc93f37 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:19.975753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5302-c884-4b63-afb6-0f74cfc93f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:19.993800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-578a5302-c884-4b63-afb6-0f74cfc93f37 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:19.994961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-578a5302-c884-4b63-afb6-0f74cfc93f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:20.034709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:20.061494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 565/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:20.331018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ec4f-d8d1-4fba-b8cb-06ea5483c6ad None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:20.429677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ec4f-d8d1-4fba-b8cb-06ea5483c6ad None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:20.462187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab51d3-7a4c-4519-ad0f-d34f355041ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:20.462791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab51d3-7a4c-4519-ad0f-d34f355041ff None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:20.463065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab51d3-7a4c-4519-ad0f-d34f355041ff None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:20.463336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab51d3-7a4c-4519-ad0f-d34f355041ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:20.464420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab51d3-7a4c-4519-ad0f-d34f355041ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:20.465845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab51d3-7a4c-4519-ad0f-d34f355041ff None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:20.467353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 572/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:20.473616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a5302-c884-4b63-afb6-0f74cfc93f37 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:20.570440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a5302-c884-4b63-afb6-0f74cfc93f37 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:20.603370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eff80-de7e-4e0d-b09c-499e8e05bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:20.603906 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eff80-de7e-4e0d-b09c-499e8e05bbdf None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:20.604185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eff80-de7e-4e0d-b09c-499e8e05bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:20.604458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eff80-de7e-4e0d-b09c-499e8e05bbdf None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:20.605240 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542eff80-de7e-4e0d-b09c-499e8e05bbdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:20.606670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542eff80-de7e-4e0d-b09c-499e8e05bbdf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:20.627646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 566/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:44:20 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:22.858706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc879-4854-4593-9d1a-7d96e1fae561 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:22.859263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc879-4854-4593-9d1a-7d96e1fae561 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:22.859263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc879-4854-4593-9d1a-7d96e1fae561 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:22.860571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 573/1139] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:22.866448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109bf0d-69a3-4e7b-9197-a0fcc8745793 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:22.866881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109bf0d-69a3-4e7b-9197-a0fcc8745793 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:22.866989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109bf0d-69a3-4e7b-9197-a0fcc8745793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:22.885137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d109bf0d-69a3-4e7b-9197-a0fcc8745793 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:22.886331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d109bf0d-69a3-4e7b-9197-a0fcc8745793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:22.909462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:22.952138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 567/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:23.220341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcc879-4854-4593-9d1a-7d96e1fae561 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:23.239707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:23.320407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcc879-4854-4593-9d1a-7d96e1fae561 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:23.354500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:23.355104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:23.355376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:23.355641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:23.365620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:23.370324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:23.371416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:23.372254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 574/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:23.377572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109bf0d-69a3-4e7b-9197-a0fcc8745793 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:23.473569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109bf0d-69a3-4e7b-9197-a0fcc8745793 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:23.505959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:23.506550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:23.506827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:23.507103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:23.507762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:23.508058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:23.509437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:23.517743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 568/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:44:23.523597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:23.601326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:23.622871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43dc0c-6b39-47eb-b8ba-f88e6df5edc8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:23.655394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:23.656017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:23.656292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:23.656559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] PATH_INFO: `/v3/users/8135b002f4b648978c1f3fc21e7e1f0a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:23.670228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] RBAC: Authorizing `identity:get_user(user_id=8135b002f4b648978c1f3fc21e7e1f0a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:23.671649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:23.673796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 575/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:23 2022] GET /identity/v3/users/8135b002f4b648978c1f3fc21e7e1f0a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:23.679660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:23.704324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:23.777538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5958cbd-4947-41b6-9766-688639cf8d79 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:23.810257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:23.810849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:23.811127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:23.811398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:23.876295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:23.877768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:23.899599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:23.973425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 569/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:23.979587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:24.075624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe88561-d96c-4e20-a331-34daeb9d6aae None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:24.109173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e5ab1-527e-471f-a53d-4308b6c09449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:24.109781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e5ab1-527e-471f-a53d-4308b6c09449 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:24.110054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e5ab1-527e-471f-a53d-4308b6c09449 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:24.110320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e5ab1-527e-471f-a53d-4308b6c09449 None admin] PATH_INFO: `/v3/projects/da08f2e0019f4005af9d7304d70b3733` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:24.111451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e5ab1-527e-471f-a53d-4308b6c09449 None admin] RBAC: Authorizing `identity:get_project(project_id=da08f2e0019f4005af9d7304d70b3733)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:24.112848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e5ab1-527e-471f-a53d-4308b6c09449 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:24.114455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 576/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:23 2022] GET /identity/v3/projects/da08f2e0019f4005af9d7304d70b3733 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:24.120450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:24.219572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8391ab-8996-4c16-b285-e8677247b0d0 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:24.242330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:24.254042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58537d99-1d64-40d3-b030-4ecfd2d7957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:24.254635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537d99-1d64-40d3-b030-4ecfd2d7957e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:24.254909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537d99-1d64-40d3-b030-4ecfd2d7957e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:24.255176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537d99-1d64-40d3-b030-4ecfd2d7957e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:24.255893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58537d99-1d64-40d3-b030-4ecfd2d7957e None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=da08f2e0019f4005af9d7304d70b3733, user.id=8135b002f4b648978c1f3fc21e7e1f0a) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:24.256195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58537d99-1d64-40d3-b030-4ecfd2d7957e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:24.257649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58537d99-1d64-40d3-b030-4ecfd2d7957e None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:24.262834 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 570/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:24 2022] GET /identity/v3/role_assignments?user.id=8135b002f4b648978c1f3fc21e7e1f0a&scope.project.id=da08f2e0019f4005af9d7304d70b3733&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:26.377140 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76671-6813-4b23-82d9-bf3af52dba88 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:26.378206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76671-6813-4b23-82d9-bf3af52dba88 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:26.378298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76671-6813-4b23-82d9-bf3af52dba88 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:26.379667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 577/1147] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:26.384833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92481d-7076-41b1-b66b-15194b78da9d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:26.385229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92481d-7076-41b1-b66b-15194b78da9d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:26.385393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92481d-7076-41b1-b66b-15194b78da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:26.403379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cc92481d-7076-41b1-b66b-15194b78da9d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:26.404549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cc92481d-7076-41b1-b66b-15194b78da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:26.468103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 571/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:44:26.737481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a76671-6813-4b23-82d9-bf3af52dba88 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:26.741327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:26.837329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a76671-6813-4b23-82d9-bf3af52dba88 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:26.870391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:26.871005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:26.871282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:26.871552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:26.881860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:26.888432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:26.889575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:26.890425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 578/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:26.896696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92481d-7076-41b1-b66b-15194b78da9d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:26.992959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92481d-7076-41b1-b66b-15194b78da9d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:27.009407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:27.027342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:27.027936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:27.028217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:27.028487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:27.029146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:27.029475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:27.030861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:27.038574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 572/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:27.044513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:27.105533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:27.142186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48261-9c32-4da9-bd7d-f4b1eedba216 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:27.175252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:27.175838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:27.176111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:27.176379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] PATH_INFO: `/v3/users/8135b002f4b648978c1f3fc21e7e1f0a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:27.177495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] RBAC: Authorizing `identity:get_user(user_id=8135b002f4b648978c1f3fc21e7e1f0a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:27.178900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:27.180439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 579/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:27 2022] GET /identity/v3/users/8135b002f4b648978c1f3fc21e7e1f0a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:27.186055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:27.284375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9907fc-d87a-4d3c-932e-d286b090642f None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:27.317072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47aff0-f8e0-4379-ab7a-2e733be0c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:27.317708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47aff0-f8e0-4379-ab7a-2e733be0c222 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:27.317978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47aff0-f8e0-4379-ab7a-2e733be0c222 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:27.318247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47aff0-f8e0-4379-ab7a-2e733be0c222 None admin] PATH_INFO: `/v3/projects/da08f2e0019f4005af9d7304d70b3733` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:27.319348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47aff0-f8e0-4379-ab7a-2e733be0c222 None admin] RBAC: Authorizing `identity:get_project(project_id=da08f2e0019f4005af9d7304d70b3733)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:27.320759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47aff0-f8e0-4379-ab7a-2e733be0c222 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:27.322383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 573/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:27 2022] GET /identity/v3/projects/da08f2e0019f4005af9d7304d70b3733 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:27.328172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:27.425397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12814bb-8ded-45fa-b1f0-2ba098cb5204 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:27.453369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:27.458506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec13d1-7815-4f80-92eb-1ac306c96d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:27.459147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec13d1-7815-4f80-92eb-1ac306c96d24 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:27.459420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec13d1-7815-4f80-92eb-1ac306c96d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:27.459686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec13d1-7815-4f80-92eb-1ac306c96d24 None admin] PATH_INFO: `/v3/projects/da08f2e0019f4005af9d7304d70b3733/users/8135b002f4b648978c1f3fc21e7e1f0a/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:27.461558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec13d1-7815-4f80-92eb-1ac306c96d24 None admin] RBAC: Authorizing `identity:create_grant(project_id=da08f2e0019f4005af9d7304d70b3733, user_id=8135b002f4b648978c1f3fc21e7e1f0a, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:27.462955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec13d1-7815-4f80-92eb-1ac306c96d24 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:27.476923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 580/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:44:27 2022] PUT /identity/v3/projects/da08f2e0019f4005af9d7304d70b3733/users/8135b002f4b648978c1f3fc21e7e1f0a/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:29.612060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a44a-31d7-4aa9-a77c-b4083af554ea None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:29.612703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a44a-31d7-4aa9-a77c-b4083af554ea None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:29.612703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a44a-31d7-4aa9-a77c-b4083af554ea None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:29.613979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 574/1154] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:29.619290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b58c7-f077-4424-a6c6-0015388eadbf None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:29.619686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b58c7-f077-4424-a6c6-0015388eadbf None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:29.619826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b58c7-f077-4424-a6c6-0015388eadbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:29.638291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-cd0b58c7-f077-4424-a6c6-0015388eadbf None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:29.639457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cd0b58c7-f077-4424-a6c6-0015388eadbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:29.705736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 581/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:29.977510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a44a-31d7-4aa9-a77c-b4083af554ea None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:30.024148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:30.075959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a44a-31d7-4aa9-a77c-b4083af554ea None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:30.109034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:30.109670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:30.109946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:30.110212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:30.120414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:30.125126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:30.126384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:44:30.127310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 575/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:30.132174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b58c7-f077-4424-a6c6-0015388eadbf None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:30.228612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b58c7-f077-4424-a6c6-0015388eadbf None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:30.259741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:30.272779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:30.273400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:30.273677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:30.273944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:30.274599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:30.274896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:30.276242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:30.284906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 582/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:30.290822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:30.388174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be503052-5dfc-4fc9-aa9b-63cffa604b8e None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:30.395366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:30.421459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:30.422074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:30.422350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:30.422619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] PATH_INFO: `/v3/users/8135b002f4b648978c1f3fc21e7e1f0a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:30.423948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] RBAC: Authorizing `identity:get_user(user_id=8135b002f4b648978c1f3fc21e7e1f0a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:30.425390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:30.426948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 576/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:30 2022] GET /identity/v3/users/8135b002f4b648978c1f3fc21e7e1f0a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:30.432739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:30.530601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc5cdf-d7e7-4a24-9bcb-09cdc98e1ce6 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:30.562319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:30.562907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:30.563182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:30.563448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:30.613389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:30.628974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:30.630424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:30.726137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 583/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:30.732316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:30.829046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440d09-2ea8-40e5-a8b3-ac42550dd619 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:30.861440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd6385-a634-4782-a761-da7b49f8d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:30.862055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd6385-a634-4782-a761-da7b49f8d67b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:30.862334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd6385-a634-4782-a761-da7b49f8d67b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:30.862611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd6385-a634-4782-a761-da7b49f8d67b None admin] PATH_INFO: `/v3/projects/da08f2e0019f4005af9d7304d70b3733` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:30.863759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd6385-a634-4782-a761-da7b49f8d67b None admin] RBAC: Authorizing `identity:get_project(project_id=da08f2e0019f4005af9d7304d70b3733)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:30.865192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd6385-a634-4782-a761-da7b49f8d67b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:30.866786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 577/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:30 2022] GET /identity/v3/projects/da08f2e0019f4005af9d7304d70b3733 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:30.872941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:30.956317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:30.972280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ccccb-b792-41da-af1c-cbf11eac25f3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:31.006377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e37422-945e-4611-b4cc-5f101c8d29a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:31.006969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37422-945e-4611-b4cc-5f101c8d29a6 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:31.007248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37422-945e-4611-b4cc-5f101c8d29a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:31.007519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37422-945e-4611-b4cc-5f101c8d29a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:31.008237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e37422-945e-4611-b4cc-5f101c8d29a6 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=da08f2e0019f4005af9d7304d70b3733, user.id=8135b002f4b648978c1f3fc21e7e1f0a) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:31.008541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e37422-945e-4611-b4cc-5f101c8d29a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:31.009978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e37422-945e-4611-b4cc-5f101c8d29a6 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:31.015557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 584/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:30 2022] GET /identity/v3/role_assignments?user.id=8135b002f4b648978c1f3fc21e7e1f0a&scope.project.id=da08f2e0019f4005af9d7304d70b3733&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:33.184432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537b61-e309-4450-92a5-91c915d13b98 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:33.184991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537b61-e309-4450-92a5-91c915d13b98 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:33.184991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537b61-e309-4450-92a5-91c915d13b98 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:33.186357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 578/1162] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:33.191803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d068b-2433-4a33-ac28-3a7b3f7f5d22 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:33.192235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d068b-2433-4a33-ac28-3a7b3f7f5d22 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:33.192335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d068b-2433-4a33-ac28-3a7b3f7f5d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:33.210710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-be0d068b-2433-4a33-ac28-3a7b3f7f5d22 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:33.211898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-be0d068b-2433-4a33-ac28-3a7b3f7f5d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:33.276830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 585/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:44:33.550282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a537b61-e309-4450-92a5-91c915d13b98 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:33.594123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:33.650277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a537b61-e309-4450-92a5-91c915d13b98 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:33.685920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:33.686520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:33.686798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:33.687071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:33.752020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:33.753475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:33.793552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:33.850936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 579/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:33.856857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d068b-2433-4a33-ac28-3a7b3f7f5d22 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:33.931204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:33.951753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d068b-2433-4a33-ac28-3a7b3f7f5d22 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:33.985324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c483-e206-4bd9-b0b5-c59db1a582eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:33.985962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c483-e206-4bd9-b0b5-c59db1a582eb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:33.986239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c483-e206-4bd9-b0b5-c59db1a582eb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:33.986508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c483-e206-4bd9-b0b5-c59db1a582eb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:33.992993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c483-e206-4bd9-b0b5-c59db1a582eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:33.994437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c483-e206-4bd9-b0b5-c59db1a582eb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-06c7c483-e206-4bd9-b0b5-c59db1a582eb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:34.006183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:34.007336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:34.008191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 586/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:44:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:34.013201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:34.109980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ffc05-504e-4e2b-a0c4-89a103ebf39d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:34.143189 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c1407-ea2d-4423-b57f-c0580b03a35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:34.143782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1407-ea2d-4423-b57f-c0580b03a35d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:34.144057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1407-ea2d-4423-b57f-c0580b03a35d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:34.144327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1407-ea2d-4423-b57f-c0580b03a35d None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:34.144965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1407-ea2d-4423-b57f-c0580b03a35d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:34.145286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1407-ea2d-4423-b57f-c0580b03a35d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:34.146631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1407-ea2d-4423-b57f-c0580b03a35d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:34.153508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 580/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Sep 19 11:44:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:36.327010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d893fe5-a469-4a5f-beb8-5548869ceea8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:36.327583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d893fe5-a469-4a5f-beb8-5548869ceea8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:36.327583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d893fe5-a469-4a5f-beb8-5548869ceea8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:36.328894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 587/1167] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:36.334851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6047e-75d6-4492-bf0a-a2e8549d3fa4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:36.335279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6047e-75d6-4492-bf0a-a2e8549d3fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:36.335382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6047e-75d6-4492-bf0a-a2e8549d3fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:36.348805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:36.354669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-30c6047e-75d6-4492-bf0a-a2e8549d3fa4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:36.355830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-30c6047e-75d6-4492-bf0a-a2e8549d3fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:36.420674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 581/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:36.694164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d893fe5-a469-4a5f-beb8-5548869ceea8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:36.795416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d893fe5-a469-4a5f-beb8-5548869ceea8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:36.827675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c372-5b46-4fff-9429-2e9441d960c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:36.828263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c372-5b46-4fff-9429-2e9441d960c0 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:36.828541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c372-5b46-4fff-9429-2e9441d960c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:36.828811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c372-5b46-4fff-9429-2e9441d960c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:36.830050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c372-5b46-4fff-9429-2e9441d960c0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:36.831396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c372-5b46-4fff-9429-2e9441d960c0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:36.840669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:36.848938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 588/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Mon Sep 19 11:44:36 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:39.013949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f34071-bc11-4c47-a6fa-f78be450dd0e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:39.014463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f34071-bc11-4c47-a6fa-f78be450dd0e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:39.014463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f34071-bc11-4c47-a6fa-f78be450dd0e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:39.015763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 582/1170] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:39.021721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b445a-8b5e-4eec-b557-300f60c0b0d8 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:39.022096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b445a-8b5e-4eec-b557-300f60c0b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:39.022272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b445a-8b5e-4eec-b557-300f60c0b0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:39.040597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9b8b445a-8b5e-4eec-b557-300f60c0b0d8 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:39.041819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9b8b445a-8b5e-4eec-b557-300f60c0b0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:39.106152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 589/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:39.373871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f34071-bc11-4c47-a6fa-f78be450dd0e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:39.473395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f34071-bc11-4c47-a6fa-f78be450dd0e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:39.506470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1c1bd-f20c-47cc-a9ca-556294cf8f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:39.507075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c1bd-f20c-47cc-a9ca-556294cf8f1c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:39.507354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c1bd-f20c-47cc-a9ca-556294cf8f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:39.507623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c1bd-f20c-47cc-a9ca-556294cf8f1c None admin] PATH_INFO: `/v3/domains/b3c651736ca943499dd343dcdfc2102a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:39.510255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:39.519172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1c1bd-f20c-47cc-a9ca-556294cf8f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=b3c651736ca943499dd343dcdfc2102a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:39.520601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1c1bd-f20c-47cc-a9ca-556294cf8f1c None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:39.522196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 583/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Mon Sep 19 11:44:39 2022] GET /identity/v3/domains/b3c651736ca943499dd343dcdfc2102a => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:39.528012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b445a-8b5e-4eec-b557-300f60c0b0d8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:39.623402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b445a-8b5e-4eec-b557-300f60c0b0d8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:39.649758 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:39.659530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c93fe-b79c-4300-8874-a817b32045c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:39.660137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c93fe-b79c-4300-8874-a817b32045c1 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:39.660443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c93fe-b79c-4300-8874-a817b32045c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:39.660715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c93fe-b79c-4300-8874-a817b32045c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:39.661406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c93fe-b79c-4300-8874-a817b32045c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:39.662820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c93fe-b79c-4300-8874-a817b32045c1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:39.688085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 590/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:44:39 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:41.909497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa2b0-4a98-4e01-ada9-45f535a4adce None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:41.910017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa2b0-4a98-4e01-ada9-45f535a4adce None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:41.910017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa2b0-4a98-4e01-ada9-45f535a4adce None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:41.911293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 584/1174] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:41.916583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202113-03e2-48c0-80e2-f25de53ce5ca None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:41.916997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202113-03e2-48c0-80e2-f25de53ce5ca None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:41.917104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202113-03e2-48c0-80e2-f25de53ce5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:41.935662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7b202113-03e2-48c0-80e2-f25de53ce5ca None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:41.936852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7b202113-03e2-48c0-80e2-f25de53ce5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:42.001885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 591/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:42.275476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fa2b0-4a98-4e01-ada9-45f535a4adce None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:42.375733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fa2b0-4a98-4e01-ada9-45f535a4adce None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:42.416599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6e157-a61c-4543-803d-aa108060609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:42.417243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6e157-a61c-4543-803d-aa108060609a None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:42.417518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6e157-a61c-4543-803d-aa108060609a None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:42.417784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6e157-a61c-4543-803d-aa108060609a None admin] PATH_INFO: `/v3/domains/b3c651736ca943499dd343dcdfc2102a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:42.418902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6e157-a61c-4543-803d-aa108060609a None admin] RBAC: Authorizing `identity:get_domain(domain_id=b3c651736ca943499dd343dcdfc2102a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:42.420303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6e157-a61c-4543-803d-aa108060609a None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:42.421873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 585/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Mon Sep 19 11:44:42 2022] GET /identity/v3/domains/b3c651736ca943499dd343dcdfc2102a => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:42.427857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202113-03e2-48c0-80e2-f25de53ce5ca None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:42.524702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202113-03e2-48c0-80e2-f25de53ce5ca None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:42.535344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:42.558210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c362a-2012-4cf8-9350-62334aa7946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:42.558807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c362a-2012-4cf8-9350-62334aa7946c None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:42.559083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c362a-2012-4cf8-9350-62334aa7946c None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:42.559353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c362a-2012-4cf8-9350-62334aa7946c None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:42.559994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c362a-2012-4cf8-9350-62334aa7946c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:42.561430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c362a-2012-4cf8-9350-62334aa7946c None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:42.582684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 592/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:44:42 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:44.765662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f9b7-6688-4ac1-af3c-7543b2ccdbda None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:44.766216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f9b7-6688-4ac1-af3c-7543b2ccdbda None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:44.766216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f9b7-6688-4ac1-af3c-7543b2ccdbda None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:44.767609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 586/1178] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:44.772953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7693-922a-4d94-a98b-4b0d75f0ce2a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:44.773392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7693-922a-4d94-a98b-4b0d75f0ce2a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:44.773520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7693-922a-4d94-a98b-4b0d75f0ce2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:44.792433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e1aa7693-922a-4d94-a98b-4b0d75f0ce2a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:44.793641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e1aa7693-922a-4d94-a98b-4b0d75f0ce2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:44.857506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 593/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:45.125208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f9b7-6688-4ac1-af3c-7543b2ccdbda None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:45.186347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:45.225098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f9b7-6688-4ac1-af3c-7543b2ccdbda None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:45.257353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:45.257967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:45.258246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:45.258519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:45.269248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:45.273985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:45.275048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:44:45.275940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 587/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:44:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:45.281062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7693-922a-4d94-a98b-4b0d75f0ce2a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:45.372818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:45.379577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7693-922a-4d94-a98b-4b0d75f0ce2a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:45.412383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:45.412975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:45.413282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:45.413552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:45.414204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:45.414500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:45.415841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:45.423559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 594/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:44:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:45.429515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:45.528799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7448b-d15f-4894-8aa8-045a1d4af179 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:45.550853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:45.561941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:45.562555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:45.562833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:45.563106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] PATH_INFO: `/v3/users/490009eeeaf14b8fbc3bc088ef12c563` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:45.576558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] RBAC: Authorizing `identity:get_user(user_id=490009eeeaf14b8fbc3bc088ef12c563)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:45.578030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:45.580184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 588/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:45 2022] GET /identity/v3/users/490009eeeaf14b8fbc3bc088ef12c563 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:45.586036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:45.683644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c14a-7a30-40f1-8a02-dea85626c8f7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:45.717087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:45.717706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:45.717978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:45.718245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:45.745001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:45.784966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:45.786410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:45.881730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 595/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:45.887688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:45.985246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e789dd6-fea6-4c8b-b19b-30eeabc36a90 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:46.018356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7c1a2-590b-4c12-9fd1-eee44b3a99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:46.018968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c1a2-590b-4c12-9fd1-eee44b3a99f5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:46.019248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c1a2-590b-4c12-9fd1-eee44b3a99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:46.019519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c1a2-590b-4c12-9fd1-eee44b3a99f5 None admin] PATH_INFO: `/v3/projects/683675da071949d680d1c27a05430734` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:46.020633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c1a2-590b-4c12-9fd1-eee44b3a99f5 None admin] RBAC: Authorizing `identity:get_project(project_id=683675da071949d680d1c27a05430734)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:46.022078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c1a2-590b-4c12-9fd1-eee44b3a99f5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:46.023667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 589/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:45 2022] GET /identity/v3/projects/683675da071949d680d1c27a05430734 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:46.029676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:46.086596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:46.126904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939939a4-8f5a-44c2-b593-c15c35385da2 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:46.159798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e272f-b910-46e6-8813-1dd277442151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:46.160382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e272f-b910-46e6-8813-1dd277442151 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:46.160651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e272f-b910-46e6-8813-1dd277442151 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:46.160914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e272f-b910-46e6-8813-1dd277442151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:46.161659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e272f-b910-46e6-8813-1dd277442151 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=683675da071949d680d1c27a05430734, user.id=490009eeeaf14b8fbc3bc088ef12c563) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:46.161960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e272f-b910-46e6-8813-1dd277442151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:46.163352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e272f-b910-46e6-8813-1dd277442151 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:46.168487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 596/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:46 2022] GET /identity/v3/role_assignments?user.id=490009eeeaf14b8fbc3bc088ef12c563&scope.project.id=683675da071949d680d1c27a05430734&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:48.291098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f3b5-d7c3-4de8-84b6-d5e2aa256b8a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:48.291699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f3b5-d7c3-4de8-84b6-d5e2aa256b8a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:48.291699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f3b5-d7c3-4de8-84b6-d5e2aa256b8a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:48.292976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 590/1186] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:48.298448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5840-bb9b-47ca-932c-18a1580a898b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:48.298846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5840-bb9b-47ca-932c-18a1580a898b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:48.298991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5840-bb9b-47ca-932c-18a1580a898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:48.317124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-32ac5840-bb9b-47ca-932c-18a1580a898b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:48.318345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-32ac5840-bb9b-47ca-932c-18a1580a898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:48.383805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 597/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:48.655772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822f3b5-d7c3-4de8-84b6-d5e2aa256b8a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:48.706346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:48.757125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822f3b5-d7c3-4de8-84b6-d5e2aa256b8a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:48.789494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:48.790106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:48.790385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:48.790657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:48.801055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:48.805821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:48.806907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:44:48.807760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 591/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:48.813078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5840-bb9b-47ca-932c-18a1580a898b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:48.864422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:48.909867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5840-bb9b-47ca-932c-18a1580a898b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:48.942519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:48.943100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:48.943371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:48.943634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:48.944283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:48.944576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:48.945929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:48.953546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 598/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:48.959945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:49.057478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f877f5f-37b5-4006-bdd4-46f838c30abf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:49.068509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:49.092369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:49.092973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:49.093276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:49.093547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] PATH_INFO: `/v3/users/490009eeeaf14b8fbc3bc088ef12c563` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:49.094725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] RBAC: Authorizing `identity:get_user(user_id=490009eeeaf14b8fbc3bc088ef12c563)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:49.096529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:49.098112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 592/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:48 2022] GET /identity/v3/users/490009eeeaf14b8fbc3bc088ef12c563 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:49.104080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:49.201043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c54fc-6827-4bd4-a5e4-5a160c03da61 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:49.214544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:49.234499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267949c-6f15-4d17-a4b4-82d2309bb30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:49.235113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267949c-6f15-4d17-a4b4-82d2309bb30e None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:49.235513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267949c-6f15-4d17-a4b4-82d2309bb30e None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:49.235889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267949c-6f15-4d17-a4b4-82d2309bb30e None admin] PATH_INFO: `/v3/projects/683675da071949d680d1c27a05430734` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:49.236985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267949c-6f15-4d17-a4b4-82d2309bb30e None admin] RBAC: Authorizing `identity:get_project(project_id=683675da071949d680d1c27a05430734)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:49.238424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267949c-6f15-4d17-a4b4-82d2309bb30e None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:49.240018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 599/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:49 2022] GET /identity/v3/projects/683675da071949d680d1c27a05430734 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:49.245883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:49.343090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9529d-cf6e-4f19-b8db-b5d5f9f952b3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:49.376984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa176437-1705-43a1-acc8-2a3edad74b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:49.377648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176437-1705-43a1-acc8-2a3edad74b53 None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:49.377929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176437-1705-43a1-acc8-2a3edad74b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:49.378199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176437-1705-43a1-acc8-2a3edad74b53 None admin] PATH_INFO: `/v3/projects/683675da071949d680d1c27a05430734/users/490009eeeaf14b8fbc3bc088ef12c563/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:49.380091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa176437-1705-43a1-acc8-2a3edad74b53 None admin] RBAC: Authorizing `identity:create_grant(project_id=683675da071949d680d1c27a05430734, user_id=490009eeeaf14b8fbc3bc088ef12c563, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:49.381548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa176437-1705-43a1-acc8-2a3edad74b53 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:49.394087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 593/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:44:49 2022] PUT /identity/v3/projects/683675da071949d680d1c27a05430734/users/490009eeeaf14b8fbc3bc088ef12c563/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:51.525810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356411-33fa-4865-b8b8-a3e4b386b134 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:51.526360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356411-33fa-4865-b8b8-a3e4b386b134 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:51.526360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356411-33fa-4865-b8b8-a3e4b386b134 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:51.527691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 600/1193] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:44:51.533691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54219d-c20c-4262-b448-d92ed5b705e4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:51.534117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54219d-c20c-4262-b448-d92ed5b705e4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:51.534217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54219d-c20c-4262-b448-d92ed5b705e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:51.553054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cb54219d-c20c-4262-b448-d92ed5b705e4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:51.554253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cb54219d-c20c-4262-b448-d92ed5b705e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:51.582215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:51.620352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 594/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:44:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:44:51.887903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356411-33fa-4865-b8b8-a3e4b386b134 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:51.987825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356411-33fa-4865-b8b8-a3e4b386b134 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:52.020563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:52.021189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:52.021467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:52.021733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:52.031393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:44:52.036510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:44:52.037703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:44:52.038569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 601/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:44:52.043501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54219d-c20c-4262-b448-d92ed5b705e4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:52.140310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54219d-c20c-4262-b448-d92ed5b705e4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:52.173571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:52.174162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:52.174442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:52.174713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:52.175375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:52.175676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:52.177030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:52.184750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 595/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:52.190528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:52.233614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:52.289109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aed241-a7f3-49df-a638-58eeb074973f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:52.322826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:52.323577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:52.323897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:52.324268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] PATH_INFO: `/v3/users/490009eeeaf14b8fbc3bc088ef12c563` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:52.325791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] RBAC: Authorizing `identity:get_user(user_id=490009eeeaf14b8fbc3bc088ef12c563)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:52.327213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:52.328766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 602/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Sep 19 11:44:52 2022] GET /identity/v3/users/490009eeeaf14b8fbc3bc088ef12c563 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:52.335065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:52.365169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:52.432375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6bc77-5f03-4108-bed1-1efcdb75ea9d None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:52.465040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:52.465655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:52.465933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:52.466203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:52.532652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:52.534104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:52.562162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:52.630187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 596/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:44:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:44:52.636240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:52.734924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23cf3a-424d-4229-a271-209822fe1720 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:52.746429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:52.769976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f884802-a22c-4e8b-9e16-0eba52612808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:52.770590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f884802-a22c-4e8b-9e16-0eba52612808 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:52.770861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f884802-a22c-4e8b-9e16-0eba52612808 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:52.771127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f884802-a22c-4e8b-9e16-0eba52612808 None admin] PATH_INFO: `/v3/projects/683675da071949d680d1c27a05430734` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:52.772208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f884802-a22c-4e8b-9e16-0eba52612808 None admin] RBAC: Authorizing `identity:get_project(project_id=683675da071949d680d1c27a05430734)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:52.773643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f884802-a22c-4e8b-9e16-0eba52612808 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:52.775224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 603/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Sep 19 11:44:52 2022] GET /identity/v3/projects/683675da071949d680d1c27a05430734 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:52.781411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:52.878593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e36a-c8ae-40cc-acbb-e7f56ca953e7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:52.905819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:52.912325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37072fbd-e109-4164-9060-d15549fac2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:52.912918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072fbd-e109-4164-9060-d15549fac2ec None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:52.913222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072fbd-e109-4164-9060-d15549fac2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:52.913499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072fbd-e109-4164-9060-d15549fac2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:52.914224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37072fbd-e109-4164-9060-d15549fac2ec None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=683675da071949d680d1c27a05430734, user.id=490009eeeaf14b8fbc3bc088ef12c563) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:52.914533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37072fbd-e109-4164-9060-d15549fac2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:52.915953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37072fbd-e109-4164-9060-d15549fac2ec None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:52.921551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 597/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:44:52 2022] GET /identity/v3/role_assignments?user.id=490009eeeaf14b8fbc3bc088ef12c563&scope.project.id=683675da071949d680d1c27a05430734&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:02.765690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=11 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:02.919139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:48.610878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0698b-60d3-494b-8f7e-af0ff54b65e9 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:48.611586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0698b-60d3-494b-8f7e-af0ff54b65e9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:48.611586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0698b-60d3-494b-8f7e-af0ff54b65e9 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:48.612738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 604/1201] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:45:48.618220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ef2fc-d0b7-43a9-8518-b0f0cd225c2f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:48.618686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ef2fc-d0b7-43a9-8518-b0f0cd225c2f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:48.618777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ef2fc-d0b7-43a9-8518-b0f0cd225c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:48.638466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-623ef2fc-d0b7-43a9-8518-b0f0cd225c2f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:48.639675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-623ef2fc-d0b7-43a9-8518-b0f0cd225c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:48.730330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 598/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:45:49.058440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0698b-60d3-494b-8f7e-af0ff54b65e9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:49.211837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0698b-60d3-494b-8f7e-af0ff54b65e9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:49.265469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:49.267102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:49.267447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:49.267872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:49.288297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:49.289896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:45:49.308179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:49.309346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:45:49.310458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:45:49.310458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:49.310458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:45:49.311865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 605/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:49.318265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ef2fc-d0b7-43a9-8518-b0f0cd225c2f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:49.459513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ef2fc-d0b7-43a9-8518-b0f0cd225c2f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:49.499296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:49.511374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ddae3-4bbf-4c10-9ac2-c64f7e37dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:49.512311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ddae3-4bbf-4c10-9ac2-c64f7e37dae5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:49.512922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ddae3-4bbf-4c10-9ac2-c64f7e37dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:49.513371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ddae3-4bbf-4c10-9ac2-c64f7e37dae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:49.514279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ddae3-4bbf-4c10-9ac2-c64f7e37dae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:49.514729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ddae3-4bbf-4c10-9ac2-c64f7e37dae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:49.517026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ddae3-4bbf-4c10-9ac2-c64f7e37dae5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:49.529868 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 599/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:49.536876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:49.612190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:49.668377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd023b3a-3eb3-4b26-a2ac-d5cd3fcb4428 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:49.709632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4453b-c659-4e7f-9cd1-ce0e26f2c673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:49.710263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4453b-c659-4e7f-9cd1-ce0e26f2c673 None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:49.710543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4453b-c659-4e7f-9cd1-ce0e26f2c673 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:49.710817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4453b-c659-4e7f-9cd1-ce0e26f2c673 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:49.711520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4453b-c659-4e7f-9cd1-ce0e26f2c673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:49.713046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4453b-c659-4e7f-9cd1-ce0e26f2c673 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:49.738953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 606/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Sep 19 11:45:49 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:45:52.157941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc7ff-8a97-40e3-b053-1a0be7c7dfb5 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:52.158825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc7ff-8a97-40e3-b053-1a0be7c7dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:52.158825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc7ff-8a97-40e3-b053-1a0be7c7dfb5 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:52.160057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 600/1206] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:45:52.166261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d300b2-6e40-4341-8810-61fc07643f64 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:52.166700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d300b2-6e40-4341-8810-61fc07643f64 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:52.166808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d300b2-6e40-4341-8810-61fc07643f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:52.187602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f0d300b2-6e40-4341-8810-61fc07643f64 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:52.189492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f0d300b2-6e40-4341-8810-61fc07643f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:52.266694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 607/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:45:52.561297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bc7ff-8a97-40e3-b053-1a0be7c7dfb5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:52.691746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bc7ff-8a97-40e3-b053-1a0be7c7dfb5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:52.732305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:52.733075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:52.733432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:52.735911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:52.750049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:45:52.755393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:52.756592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:45:52.757669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:52.761665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 601/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:52.764934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d300b2-6e40-4341-8810-61fc07643f64 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:52.811574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:52.889289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d300b2-6e40-4341-8810-61fc07643f64 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:52.933908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:52.934612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:52.934896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:52.935190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:52.935976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:52.936306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:52.938158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:52.947772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 608/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:52.954137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:53.018005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:53.087734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdcf1-ab5e-464e-95ac-f38d526672ba None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:53.126952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:53.127598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:53.127881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:53.128188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:53.140495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:53.142342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:45:53.161773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:53.163524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:45:53.164697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:45:53.164697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:53.164697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:53.164697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 602/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:53.168682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:53.297623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:53.301049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507c54c-6ee5-49cf-bd4e-7ec6f1c16167 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:53.347897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:53.348431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:53.348708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:53.348980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:53.349832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:53.350142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:53.351868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:53.368661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 609/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:53.374951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:53.496598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16219b6a-0e1d-4de3-98c2-4417612ee3cc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:53.498495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:53.541762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:53.542406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:53.542743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:53.543021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:53.551679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:53.553161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:45:53.567948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:53.569283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:45:53.570648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:53.577332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:53.580485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 603/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:45:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:53.717415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc574b3-8955-41fd-9607-acd7d9275ff4 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:53.775978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:53.776702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:53.776983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:53.777292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:53.778050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:53.778359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:53.779853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:53.806422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 610/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Sep 19 11:45:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:45:53.813722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:53.928489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba0c0b-815b-412b-a17b-5177eecc3eac None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:53.964279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:53.965290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:53.965640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:53.965981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:53.997535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:54.037890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:54.039374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:54.162067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 604/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:45:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:45:54.167991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:54.188817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:54.280770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00303b-be1e-4a12-9a78-ba63847eb801 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:54.321453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:54.322238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:54.322644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:54.323053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:54.335665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:54.337513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:45:54.355613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:54.356794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:45:54.357857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:45:54.357857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:54.357857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:45:54.357857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 611/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:54.362966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:54.434736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:54.478785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e816-dc8c-4b30-b4cf-830d13826cc6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:54.517564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:54.518176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:54.518457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:54.518726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:54.519375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:54.519670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:54.521041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:54.534942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 605/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:54.540735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:54.625694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:54.667526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054b64e-4cad-4878-a3ca-ec82b59ffa00 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:54.720989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:54.722135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:54.722613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:54.723087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:54.736413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:54.738118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:45:54.760237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:54.761293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:45:54.762210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:45:54.767676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 612/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:54.771342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:54.908012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eee71-51ed-41e2-9796-c220c6fe549b None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:54.933929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:54.949514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00437-f7ef-4da4-ba9f-c042d663af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:54.950140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00437-f7ef-4da4-ba9f-c042d663af87 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:54.950422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00437-f7ef-4da4-ba9f-c042d663af87 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:54.950696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00437-f7ef-4da4-ba9f-c042d663af87 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:54.951407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00437-f7ef-4da4-ba9f-c042d663af87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:54.951716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00437-f7ef-4da4-ba9f-c042d663af87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:54.953281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00437-f7ef-4da4-ba9f-c042d663af87 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:54.970916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 606/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:54.977887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:55.114890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56579-3cd2-406c-9e13-61951681c2c3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:55.151386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:55.158099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7ecf6-816a-497a-a3c5-8ca0bc40e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:55.158744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ecf6-816a-497a-a3c5-8ca0bc40e039 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:55.159099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ecf6-816a-497a-a3c5-8ca0bc40e039 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:55.159378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ecf6-816a-497a-a3c5-8ca0bc40e039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:55.160136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7ecf6-816a-497a-a3c5-8ca0bc40e039 None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=cc9135818040417292f1f2bcb588a105) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:55.160481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7ecf6-816a-497a-a3c5-8ca0bc40e039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:55.162015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7ecf6-816a-497a-a3c5-8ca0bc40e039 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:55.168428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 613/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:45:54 2022] GET /identity/v3/role_assignments?user.id=cc9135818040417292f1f2bcb588a105&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:57.402760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c587e-796f-4ab7-af1a-02ba075f16fa None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:57.403334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c587e-796f-4ab7-af1a-02ba075f16fa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:57.403334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c587e-796f-4ab7-af1a-02ba075f16fa None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:57.404815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 607/1220] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:45:57.410697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4852e1-99a0-48d6-9735-3369498a6951 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:57.411208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4852e1-99a0-48d6-9735-3369498a6951 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:57.411333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4852e1-99a0-48d6-9735-3369498a6951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:57.431627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ec4852e1-99a0-48d6-9735-3369498a6951 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:57.432801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ec4852e1-99a0-48d6-9735-3369498a6951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:57.509200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 614/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:45:57.805360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c587e-796f-4ab7-af1a-02ba075f16fa None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:57.917181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c587e-796f-4ab7-af1a-02ba075f16fa None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:57.953859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:57.954673 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:57.954950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:57.955221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:57.970124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:45:57.975658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:57.976855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:57.978029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 608/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:57.983111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4852e1-99a0-48d6-9735-3369498a6951 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:58.100401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4852e1-99a0-48d6-9735-3369498a6951 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:58.127989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:58.140545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:58.141335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:58.141610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:58.141881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:58.142543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:58.142845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:58.144193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:58.152678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 615/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:45:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:45:58.159040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:58.206885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:58.277688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a2a0-aa91-4c16-b793-766efe8645bc None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:58.311492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:58.312108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:58.312379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:58.313201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:58.324555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:58.326040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:45:58.341517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:58.342788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:45:58.344350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:45:58.344350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:58.344350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:58.344350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 609/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:58.349943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:58.463383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba9314-2a97-4314-9efa-99e321d48bb0 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:58.499376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:58.499979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:58.500279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:58.501228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:58.502127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:58.502354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:58.503704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:58.515526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 616/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:58.521849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:58.626013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:58.633792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8056ad9-125d-4f08-bb97-a034241bf8b1 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:58.669753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:58.670386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:58.670770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:58.671126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:58.680511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:58.682329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:45:58.695316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:58.696372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:58.697351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 610/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:45:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:58.702889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:58.756410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:58.815508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d28c7-3057-407b-ab17-715be85beab7 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:58.855433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:58.856083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:58.856388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:58.856658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:58.857460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:58.857762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:58.859173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:58.878198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 617/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Sep 19 11:45:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:58.884609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:58.997917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41170-1163-4e5e-94de-6793788c4237 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:59.032248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:59.032907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:59.033226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:59.033510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:59.047697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:59.049866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:45:59.065763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:59.066964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:45:59.068048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:45:59.068048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:45:59.068048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:59.068048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 611/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:59.073509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:59.182466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901a451-1286-4bba-a747-28ae031e01ff None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:59.185005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:59.222864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:59.223500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:59.223796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:59.224180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:59.224923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:59.225280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:59.226856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:59.239164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 618/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:45:59.245633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:59.256238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:59.368201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516fd4d-2fcd-4f82-bd3d-145526f58892 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:59.404954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:59.405753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:59.406035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:59.406327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:59.413722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:59.415176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:45:59.426706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:45:59.427676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:45:59.428572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 612/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:45:59.433635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:59.544762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348919a9-6af6-4447-9b37-63f68ea3881b None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:59.584723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679bbfc-cca0-4d04-a5c4-3b880f617487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:59.585358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679bbfc-cca0-4d04-a5c4-3b880f617487 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:59.585638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679bbfc-cca0-4d04-a5c4-3b880f617487 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:59.585910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679bbfc-cca0-4d04-a5c4-3b880f617487 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:59.586598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679bbfc-cca0-4d04-a5c4-3b880f617487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:59.586904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679bbfc-cca0-4d04-a5c4-3b880f617487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:59.589966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679bbfc-cca0-4d04-a5c4-3b880f617487 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:59.608721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 619/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:59.610594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:59.688416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:59.725411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a644-7f92-45c0-99a3-451f85b65cb3 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:59.765139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c1f45-cd94-4a3c-b21a-da5fbd975dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:59.765938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1f45-cd94-4a3c-b21a-da5fbd975dca None admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:59.766267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1f45-cd94-4a3c-b21a-da5fbd975dca None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:59.766578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c1f45-cd94-4a3c-b21a-da5fbd975dca None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/cc9135818040417292f1f2bcb588a105/roles/e1851a550fc04d8fb28a3fbaafed04de` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:59.783218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c1f45-cd94-4a3c-b21a-da5fbd975dca None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=cc9135818040417292f1f2bcb588a105, role_id=e1851a550fc04d8fb28a3fbaafed04de)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:59.784828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c1f45-cd94-4a3c-b21a-da5fbd975dca None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:59.799192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 613/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:45:59 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/cc9135818040417292f1f2bcb588a105/roles/e1851a550fc04d8fb28a3fbaafed04de => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:46:02.273925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6de9-493b-4fc3-a075-e7cf279dd09c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:02.274571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6de9-493b-4fc3-a075-e7cf279dd09c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:02.274571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6de9-493b-4fc3-a075-e7cf279dd09c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:02.275937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 620/1233] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:46:02.282959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b63de-5eb3-4435-8283-f7564a59210c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:02.283513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b63de-5eb3-4435-8283-f7564a59210c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:02.283629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b63de-5eb3-4435-8283-f7564a59210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:02.303820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ae1b63de-5eb3-4435-8283-f7564a59210c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:02.305110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ae1b63de-5eb3-4435-8283-f7564a59210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:02.387150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 614/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:02.672951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc6de9-493b-4fc3-a075-e7cf279dd09c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:02.701681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:02.794613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc6de9-493b-4fc3-a075-e7cf279dd09c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:02.834603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:02.835603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:02.835886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:02.836152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:02.848141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:46:02.854203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:02.855533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:02.856454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 621/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Sep 19 11:46:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:02.862509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b63de-5eb3-4435-8283-f7564a59210c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:02.920529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:02.979396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b63de-5eb3-4435-8283-f7564a59210c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:03.015168 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:03.015938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:03.016214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:03.016482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:03.017133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] RBAC: Adding query filter params (name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:03.017456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:03.018811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:03.026570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 615/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Sep 19 11:46:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:03.032868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:03.129984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:03.147158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31573b-650f-4c14-ab9e-0f21060536cf None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:03.182368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:03.182918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:03.183193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:03.183461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:03.193869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:03.195283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:03.209548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:03.210534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:03.211442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:03.211442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:03.211442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:03.211442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 622/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:03.216708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:03.328489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb1994-3f86-4667-b552-901bd9153346 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:03.339191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:03.371718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:03.372392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:03.372704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:03.373005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:03.373727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:03.374067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:03.375684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:03.388506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 616/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:46:03.394719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:03.507387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24341e-7f32-44c1-b4e2-0979f671616a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:03.546196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:03.547022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:03.547909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:03.548174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:03.551030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:03.556807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:03.558753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:46:03.571292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:03.572403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:03.573429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 623/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:46:03.579243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:03.694086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a1cb-2ea0-4107-afff-185617445621 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:03.737427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:03.738036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:03.738316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:03.738589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:03.739323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:03.739628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:03.741055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:03.762178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 617/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Sep 19 11:46:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:03.769179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:03.890481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814331b-90d3-4490-8ee7-a25f79f748bb None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:03.930152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:03.930781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:03.931067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:03.931320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:03.998323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:04.005770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:04.007206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:04.125050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 624/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:46:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:46:04.130910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:04.160266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:04.241649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b20bd-98a9-4ad9-964f-8726c36688bf None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:04.280458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:04.281095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:04.281960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:04.282237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:04.293107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:04.294996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:04.314687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:04.315773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:04.322156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:04.322156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:04.322156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:04.322156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 618/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:46:04.323535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:04.432700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:04.442430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2eae8-d749-4dac-b856-28972345c9be None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:04.478210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:04.478807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:04.479080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:04.479347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:04.479974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:04.480265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:04.481637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:04.495047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 625/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:04.501278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:04.584486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:04.611339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea94f5-6439-4b1a-aaf5-c31dc29a18c5 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:04.654522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:04.655515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:04.655998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:04.656592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:04.665350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:04.666826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:46:04.678791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:04.679887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:04.681106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 619/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:04.688654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:04.795913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05e37-32d4-44a1-b421-5c67ca4632aa None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:04.836135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ff80-55af-471e-9a8d-c70328620d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:04.836811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ff80-55af-471e-9a8d-c70328620d36 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:04.837093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ff80-55af-471e-9a8d-c70328620d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:04.837394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ff80-55af-471e-9a8d-c70328620d36 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:04.838235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ff80-55af-471e-9a8d-c70328620d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:04.838540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ff80-55af-471e-9a8d-c70328620d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:04.839991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ff80-55af-471e-9a8d-c70328620d36 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:04.854303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 626/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:04.861974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:04.980573 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46bbc6-5e80-40c3-9837-f7c8fadafb46 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:05.017666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada63737-3c08-4483-a7b4-a9183afa25ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:05.018394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63737-3c08-4483-a7b4-a9183afa25ef None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:05.018671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63737-3c08-4483-a7b4-a9183afa25ef None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:05.018942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63737-3c08-4483-a7b4-a9183afa25ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:05.019694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63737-3c08-4483-a7b4-a9183afa25ef None admin] RBAC: Adding query filter params (role.id=e1851a550fc04d8fb28a3fbaafed04de, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=cc9135818040417292f1f2bcb588a105) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:05.020021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63737-3c08-4483-a7b4-a9183afa25ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:05.021521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63737-3c08-4483-a7b4-a9183afa25ef None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:05.027583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 620/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:46:04 2022] GET /identity/v3/role_assignments?user.id=cc9135818040417292f1f2bcb588a105&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=e1851a550fc04d8fb28a3fbaafed04de => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:07.671642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ca82-1a5a-463e-9494-3da3128dae0c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:07.672717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ca82-1a5a-463e-9494-3da3128dae0c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:07.672717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ca82-1a5a-463e-9494-3da3128dae0c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:07.674051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 627/1247] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:46:07.680256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1b368-b30d-4b5c-bc0e-f3d9d41f5d15 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:07.680709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1b368-b30d-4b5c-bc0e-f3d9d41f5d15 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:07.680811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1b368-b30d-4b5c-bc0e-f3d9d41f5d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:07.688842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:07.703482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4ab1b368-b30d-4b5c-bc0e-f3d9d41f5d15 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:07.704870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4ab1b368-b30d-4b5c-bc0e-f3d9d41f5d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:07.779404 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 621/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:08.070945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0ca82-1a5a-463e-9494-3da3128dae0c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:08.090808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:08.183962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0ca82-1a5a-463e-9494-3da3128dae0c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:08.221577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:08.222184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:08.222455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:08.222725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:08.233401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:46:08.239097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:08.240280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:08.241323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 628/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:46:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:08.246980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1b368-b30d-4b5c-bc0e-f3d9d41f5d15 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:08.361384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1b368-b30d-4b5c-bc0e-f3d9d41f5d15 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:08.398994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:08.404447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:08.405069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:08.405407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:08.405676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:08.406513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:08.406816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:08.408400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:08.417600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 622/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:46:08.424280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:08.529918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:08.566990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac517c6f-6604-440c-ba93-c7c6dd6216f5 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:08.613986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:08.614542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:08.614889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:08.615160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:08.627957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:08.629537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:08.646036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:08.647283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:08.648680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:08.648680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:08.648680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:08.648680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 629/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:46:08.654762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:08.773912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8d37-28ce-47ca-8787-22b617e0d4df None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:08.810740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:08.811357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:08.811634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:08.811905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:08.812555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:08.812918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:08.814327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:08.831473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 623/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:46:08.832796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:08.943602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e66c-53b4-4bf6-9e74-d948031c27a3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:08.972247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:08.981521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:08.982168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:08.982442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:08.982713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:08.991632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:08.993082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:46:09.005433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:09.006581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:09.007819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 630/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:09.012453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:09.071593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:09.119170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b59f-d6c7-40d7-8c07-06b595f30518 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:09.155175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:09.155798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:09.156076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:09.156408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:09.157200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:09.157502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:09.159424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:09.176974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 624/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Sep 19 11:46:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:09.183149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:09.291368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b9eea-80cd-4ea7-9948-352ff107626f None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:09.324319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:09.324909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:09.325207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:09.325478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:09.394254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:09.406894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:09.408283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:09.504301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 631/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:46:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:46:09.510154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:09.607664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23032a5-4922-43ab-9cd7-25f6be3cbceb None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:09.620693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:09.642237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:09.642858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:09.643134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:09.643403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:09.653445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:09.654883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:09.670264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:09.671425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:09.672948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:09.672948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:09.672948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:09.672948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 625/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:09.677895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:09.762488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:09.775114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdd96d-bade-4e61-8fb6-7c42a2babf36 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:09.809377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:09.809974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:09.810248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:09.810511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:09.811139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:09.811435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:09.812813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:09.823694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 632/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:09.829968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:09.928679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d36cb-ad0a-44cb-a881-577b85b842ce None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:09.961334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:09.961942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:09.962214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:09.962479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:09.968814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:09.971125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:46:09.983024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:09.984068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:09.985213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 626/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:09.989993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:10.087956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a319f-963b-4523-b0b3-bdddfacff124 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:10.120627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10313a8a-c5c8-4f22-906f-28432221d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:10.121247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10313a8a-c5c8-4f22-906f-28432221d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:10.121520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10313a8a-c5c8-4f22-906f-28432221d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:10.121785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10313a8a-c5c8-4f22-906f-28432221d9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:10.122460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10313a8a-c5c8-4f22-906f-28432221d9e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:10.122756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10313a8a-c5c8-4f22-906f-28432221d9e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:10.124187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10313a8a-c5c8-4f22-906f-28432221d9e4 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:10.136578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 633/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:10.143417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:10.168474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:10.242797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516a86-84ca-45f7-a56e-b6baafcbffd7 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:10.276664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec64e61-8656-4fd6-98eb-b56613301d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:10.277277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64e61-8656-4fd6-98eb-b56613301d85 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:10.277556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64e61-8656-4fd6-98eb-b56613301d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:10.277824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64e61-8656-4fd6-98eb-b56613301d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:10.278535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec64e61-8656-4fd6-98eb-b56613301d85 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=cc9135818040417292f1f2bcb588a105) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:10.278835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec64e61-8656-4fd6-98eb-b56613301d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:10.280244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec64e61-8656-4fd6-98eb-b56613301d85 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:10.285779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 627/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:46:10 2022] GET /identity/v3/role_assignments?user.id=cc9135818040417292f1f2bcb588a105&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:12.447069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278129f-ea1a-4c83-8e4d-935bc08714f6 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:12.447636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278129f-ea1a-4c83-8e4d-935bc08714f6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:12.447636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278129f-ea1a-4c83-8e4d-935bc08714f6 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:12.448932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 634/1261] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:46:12.454157 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97d97-f3a2-414f-95d6-c9feae704278 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:12.454585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97d97-f3a2-414f-95d6-c9feae704278 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:12.454712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97d97-f3a2-414f-95d6-c9feae704278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:12.473060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-76b97d97-f3a2-414f-95d6-c9feae704278 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:12.474279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-76b97d97-f3a2-414f-95d6-c9feae704278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:12.539285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 628/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:12.808293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278129f-ea1a-4c83-8e4d-935bc08714f6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:12.819740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:12.908065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278129f-ea1a-4c83-8e4d-935bc08714f6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:12.941395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:12.942008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:12.942281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:12.942550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:12.952611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:46:12.957766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:12.958930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:12.960154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 635/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:46:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:12.964848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97d97-f3a2-414f-95d6-c9feae704278 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:12.982820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:13.062291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97d97-f3a2-414f-95d6-c9feae704278 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:13.095742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:13.096340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:13.096615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:13.096887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:13.097584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:13.097884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:13.099244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:13.107208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 629/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:46:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:13.113772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:13.179393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:13.211703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36f66-2004-408f-a94d-8603fb9c4cae None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:13.245573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:13.246180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:13.246450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:13.246714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:13.256638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:13.258086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:13.272321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:13.273423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:13.274693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:13.274693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:13.274693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:13.274693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 636/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:13.279291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:13.372593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:13.398345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c734f4-0199-4d32-9865-51c7d9c44836 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:13.434290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:13.434892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:13.435172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:13.435444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:13.436085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:13.436386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:13.437797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:13.449267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 630/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:13.455661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:13.553225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a4bba-7427-45d2-b6ad-ac31d520f178 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:13.572065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:13.586908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:13.587524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:13.587803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:13.588073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:13.596935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:13.598391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:46:13.609790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:13.611442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:13.612670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 637/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:13.616714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:13.715294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f93af-f3be-42d6-949d-f58adc7fd0ed None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:13.750711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:13.751311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:13.751584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:13.751854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:13.752574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:13.752874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:13.754308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:13.762529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:13.772470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 631/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Sep 19 11:46:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:13.778355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:13.876040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f063-32f5-480b-99c3-fbffeae07736 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:13.908461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:13.909005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:13.909312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:13.909581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:13.919644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:13.921055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:13.934794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:13.935893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:13.936777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:13.936777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:13.936777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:13.936777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 638/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:13.942123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:14.041711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1e09b-70e8-4fc9-ac78-673b102721f9 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:14.074543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:14.075138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:14.075414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:14.075683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:14.076315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:14.076610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:14.077980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:14.089577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 632/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:14.095349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:14.126869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:14.194371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde75b0-b35d-485d-be8b-f74473a3954d None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:14.227171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:14.227790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:14.228067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:14.228592 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:14.235764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:14.237204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:46:14.248193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:14.249318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:14.251329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 639/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:14.255649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:14.311910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:14.361568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051a6e-8ba7-4b4f-aee6-7aca81087ca6 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:14.395862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04c54-2c8c-4ed1-b3b5-01bc93844cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:14.396458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04c54-2c8c-4ed1-b3b5-01bc93844cef None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:14.396741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04c54-2c8c-4ed1-b3b5-01bc93844cef None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:14.397014 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04c54-2c8c-4ed1-b3b5-01bc93844cef None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:14.397738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04c54-2c8c-4ed1-b3b5-01bc93844cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:14.398043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04c54-2c8c-4ed1-b3b5-01bc93844cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:14.399458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04c54-2c8c-4ed1-b3b5-01bc93844cef None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:14.411334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 633/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:14.417322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:14.507137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:14.516426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194d3b9-a3af-4aec-9f39-f54b35594bd8 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:14.549506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ecc82-4134-4e9a-a184-26e8547f7050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:14.550147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ecc82-4134-4e9a-a184-26e8547f7050 None admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:14.550420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ecc82-4134-4e9a-a184-26e8547f7050 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:14.550686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ecc82-4134-4e9a-a184-26e8547f7050 None admin] PATH_INFO: `/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/cc9135818040417292f1f2bcb588a105/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:14.552575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ecc82-4134-4e9a-a184-26e8547f7050 None admin] RBAC: Authorizing `identity:create_grant(project_id=145ac7c6b0604395a2d42e23e27404b1, user_id=cc9135818040417292f1f2bcb588a105, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:14.553996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ecc82-4134-4e9a-a184-26e8547f7050 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:14.566770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 640/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Sep 19 11:46:14 2022] PUT /identity/v3/projects/145ac7c6b0604395a2d42e23e27404b1/users/cc9135818040417292f1f2bcb588a105/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:46:16.717671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4ef7-be3e-41d5-b751-a9e3e408e982 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:16.718197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4ef7-be3e-41d5-b751-a9e3e408e982 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:16.718197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4ef7-be3e-41d5-b751-a9e3e408e982 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:16.719850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 634/1274] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:46:16.724977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb852b1-247e-4c2e-b483-1cc904cdf4cb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:16.725431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb852b1-247e-4c2e-b483-1cc904cdf4cb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:16.725566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb852b1-247e-4c2e-b483-1cc904cdf4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:16.744235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3eb852b1-247e-4c2e-b483-1cc904cdf4cb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:16.745460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3eb852b1-247e-4c2e-b483-1cc904cdf4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:16.812356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 641/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:17.080191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4ef7-be3e-41d5-b751-a9e3e408e982 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:17.179914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4ef7-be3e-41d5-b751-a9e3e408e982 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:17.196577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:17.214035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:17.214656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:17.214935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:17.215209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:17.225647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:46:17.230678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:17.231732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:17.232754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 635/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Sep 19 11:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:17.237855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb852b1-247e-4c2e-b483-1cc904cdf4cb None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:17.316169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:17.337032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb852b1-247e-4c2e-b483-1cc904cdf4cb None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:17.379867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:17.380652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:17.381131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:17.381620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:17.382811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:17.383469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:17.385645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:17.398294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 642/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Sep 19 11:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:17.407134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:17.506245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37985a66-3514-4b2f-91dc-6832ab704f8c None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:17.539270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:17.539886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:17.540167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:17.540442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:17.550507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:17.551922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:17.566675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:17.567828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:17.568790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:17.568790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:17.568790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:17.568790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 636/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:17.573799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:17.673046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae32c6-63a7-4009-ab02-36eeef0de40a None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:17.706388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:17.706982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:17.707259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:17.707524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:17.708155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:17.708454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:17.709850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:17.721104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 643/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:17.726953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:17.758209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:17.827294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f74c5-a0c8-468c-a145-880fdd400609 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:17.859942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:17.860546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:17.860822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:17.861094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:17.868259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:17.869720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:46:17.881088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:17.882222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:17.883346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 637/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:17.888091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:17.892569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:17.985927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060de8-b2b4-4ea2-891e-aaab109bfc32 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:18.018769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:18.019374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:18.019649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:18.019918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:18.020640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:18.020943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:18.022386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:18.039043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 644/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Sep 19 11:46:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:18.044737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:18.133005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:18.142752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4040d0-eec4-4686-9a79-d1c3197a9310 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:18.175175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:18.175761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:18.176040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:18.176310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:18.241451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:18.242826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:18.327487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:18.339480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 638/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Sep 19 11:46:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:46:18.345858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:18.405360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:18.443209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a2653-93de-4b0a-85a1-7148b7bb30e1 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:18.476011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:18.476621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:18.476899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:18.477190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:18.487861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:18.489314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:46:18.503520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:18.504611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:46:18.505542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:46:18.505542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:46:18.505542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:18.505542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 645/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:18.510169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:18.606289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3bea0-4154-4ffc-ab4f-24f9833e5888 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:18.639300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:18.639894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:18.640171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:18.640443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:18.641244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:18.641550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:18.642901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:18.654195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 639/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Sep 19 11:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:18.660490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:18.758428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c089c9-f9ba-4385-a936-7c5177153107 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:18.772334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:18.792441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:18.793045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:18.793348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:18.793612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:18.800363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:18.801824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:46:18.813771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:18.814799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: ERROR keystone.server.flask.application Sep 19 11:46:18.815896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 646/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Sep 19 11:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:18.820613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:18.871382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:18.919469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218f68-5817-4529-8c00-39f1c7218857 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:18.952197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb5940-965e-47c0-b246-c36d8bdb4aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:18.952790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb5940-965e-47c0-b246-c36d8bdb4aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:18.953067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb5940-965e-47c0-b246-c36d8bdb4aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:18.953437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb5940-965e-47c0-b246-c36d8bdb4aa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:18.954270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb5940-965e-47c0-b246-c36d8bdb4aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:18.954571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb5940-965e-47c0-b246-c36d8bdb4aa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:18.955978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb5940-965e-47c0-b246-c36d8bdb4aa7 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:18.968218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 640/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Sep 19 11:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:18.974278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:19.072500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de691d-baf5-455e-a666-ecfc05bd7f88 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:19.106533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd9522-1f6c-40fa-90b6-58c921a06ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:19.107122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9522-1f6c-40fa-90b6-58c921a06ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:19.107394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9522-1f6c-40fa-90b6-58c921a06ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:19.107659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9522-1f6c-40fa-90b6-58c921a06ed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:19.108368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9522-1f6c-40fa-90b6-58c921a06ed8 None admin] RBAC: Adding query filter params (role.id=f473d5477c1c48b2ad4ee9d4136deeaf, scope.project.id=145ac7c6b0604395a2d42e23e27404b1, user.id=cc9135818040417292f1f2bcb588a105) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:19.108669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9522-1f6c-40fa-90b6-58c921a06ed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:19.110744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9522-1f6c-40fa-90b6-58c921a06ed8 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:19.116341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 647/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Sep 19 11:46:18 2022] GET /identity/v3/role_assignments?user.id=cc9135818040417292f1f2bcb588a105&scope.project.id=145ac7c6b0604395a2d42e23e27404b1&role.id=f473d5477c1c48b2ad4ee9d4136deeaf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:21.266669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab3931-b186-46e5-9d69-93149a788f21 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:21.267251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab3931-b186-46e5-9d69-93149a788f21 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:21.267347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab3931-b186-46e5-9d69-93149a788f21 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:21.268703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 641/1288] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:46:21.273807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76530d5-f878-4c90-a075-4aee55ae5c54 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:21.274221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76530d5-f878-4c90-a075-4aee55ae5c54 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:21.274330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76530d5-f878-4c90-a075-4aee55ae5c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:21.292068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b76530d5-f878-4c90-a075-4aee55ae5c54 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:21.293272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b76530d5-f878-4c90-a075-4aee55ae5c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:21.322836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:21.365721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 648/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:21.661302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab3931-b186-46e5-9d69-93149a788f21 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:21.759076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab3931-b186-46e5-9d69-93149a788f21 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:21.770243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:21.793726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:21.794353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:21.794670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:21.794978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:21.795584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:21.797029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:21.805750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:21.806972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:21.808234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 642/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:46:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:21.812954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76530d5-f878-4c90-a075-4aee55ae5c54 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:21.909319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76530d5-f878-4c90-a075-4aee55ae5c54 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:21.941807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16bc62-c46c-4243-b72f-d54a4b1cf1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:21.942397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16bc62-c46c-4243-b72f-d54a4b1cf1cf None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:21.942675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16bc62-c46c-4243-b72f-d54a4b1cf1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:21.942946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16bc62-c46c-4243-b72f-d54a4b1cf1cf None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:21.943572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16bc62-c46c-4243-b72f-d54a4b1cf1cf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:21.943872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16bc62-c46c-4243-b72f-d54a4b1cf1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:21.945244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16bc62-c46c-4243-b72f-d54a4b1cf1cf None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:21.949887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 649/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Sep 19 11:46:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:21.956572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:22.053916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac225ad-b415-4131-9653-43cd20654893 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:22.086977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa0f4b-5cfd-458f-b544-31444d3ac680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:22.087553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0f4b-5cfd-458f-b544-31444d3ac680 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:22.087827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0f4b-5cfd-458f-b544-31444d3ac680 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:22.088092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0f4b-5cfd-458f-b544-31444d3ac680 None admin] PATH_INFO: `/v3/services` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:22.088707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa0f4b-5cfd-458f-b544-31444d3ac680 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:22.089003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa0f4b-5cfd-458f-b544-31444d3ac680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:22.090363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa0f4b-5cfd-458f-b544-31444d3ac680 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:22.094981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 643/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Sep 19 11:46:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:24.224707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28eff-a09c-42d2-ba90-cf829dfcdf7f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:24.225263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28eff-a09c-42d2-ba90-cf829dfcdf7f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:24.225355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b28eff-a09c-42d2-ba90-cf829dfcdf7f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:24.226623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 650/1293] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:46:24.232065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253626e-3f47-4bb5-a28a-858227a1544b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:24.232497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253626e-3f47-4bb5-a28a-858227a1544b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:24.232590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253626e-3f47-4bb5-a28a-858227a1544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:24.250957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9253626e-3f47-4bb5-a28a-858227a1544b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:24.252160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9253626e-3f47-4bb5-a28a-858227a1544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:24.281893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:24.318391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 644/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:24.588882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b28eff-a09c-42d2-ba90-cf829dfcdf7f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:24.619714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:24.692021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b28eff-a09c-42d2-ba90-cf829dfcdf7f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:24.724790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b62be3-7c98-4edb-a218-dd25ea54004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:24.725414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62be3-7c98-4edb-a218-dd25ea54004b None admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:24.725690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62be3-7c98-4edb-a218-dd25ea54004b None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:24.725958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62be3-7c98-4edb-a218-dd25ea54004b None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:24.726604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b62be3-7c98-4edb-a218-dd25ea54004b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:24.727942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b62be3-7c98-4edb-a218-dd25ea54004b None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:24.742594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 651/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Sep 19 11:46:24 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:46:26.879942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2513-e8a1-4978-a5b6-2dd2f944066d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:26.880462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2513-e8a1-4978-a5b6-2dd2f944066d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:26.880462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2513-e8a1-4978-a5b6-2dd2f944066d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:26.881878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 645/1296] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:46:26.886941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504851-13f8-4d73-8e82-8630047bbfda None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:26.887314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504851-13f8-4d73-8e82-8630047bbfda None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:26.887495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504851-13f8-4d73-8e82-8630047bbfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:26.905498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-8d504851-13f8-4d73-8e82-8630047bbfda None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:26.907310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8d504851-13f8-4d73-8e82-8630047bbfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:26.977873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 652/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:27.241933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc2513-e8a1-4978-a5b6-2dd2f944066d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:27.343449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc2513-e8a1-4978-a5b6-2dd2f944066d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:27.380296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:27.380915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:27.381237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:27.381504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:27.382052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:27.383454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:27.393456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:27.394921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:27.396069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 646/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:46:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:27.400743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504851-13f8-4d73-8e82-8630047bbfda None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:27.419640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:27.497881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504851-13f8-4d73-8e82-8630047bbfda None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:27.531980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:27.532564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:27.532837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:27.533102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:27.533777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:27.534073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:27.535407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:27.540307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 653/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Sep 19 11:46:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:27.546477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:27.577391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:27.646583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48b0d-51de-4ecc-9301-dc5677fb00aa None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:27.679006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120d3e4-70b3-48bc-ae04-03c93196b8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:27.679604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120d3e4-70b3-48bc-ae04-03c93196b8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:27.679881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120d3e4-70b3-48bc-ae04-03c93196b8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:27.680151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120d3e4-70b3-48bc-ae04-03c93196b8a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:27.680847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120d3e4-70b3-48bc-ae04-03c93196b8a5 None admin] RBAC: Adding query filter params (interface=public, service_id=ec49128324d943df873b6a8032883a2f, region_id=RegionOne) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:27.681170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120d3e4-70b3-48bc-ae04-03c93196b8a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:27.682515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120d3e4-70b3-48bc-ae04-03c93196b8a5 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:27.687283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 647/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Sep 19 11:46:27 2022] GET /identity/v3/endpoints?service_id=ec49128324d943df873b6a8032883a2f&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:27.693892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:27.773619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:27.791572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39a5e-64da-4398-ae73-f0c43efba7e3 None admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:27.825077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd26fe-44b8-4cf8-ab7c-d6e402435d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:27.825690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd26fe-44b8-4cf8-ab7c-d6e402435d60 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:27.825966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd26fe-44b8-4cf8-ab7c-d6e402435d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:27.826236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd26fe-44b8-4cf8-ab7c-d6e402435d60 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:27.826833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd26fe-44b8-4cf8-ab7c-d6e402435d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:27.828208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd26fe-44b8-4cf8-ab7c-d6e402435d60 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:27.835009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 654/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Sep 19 11:46:27 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:46:29.956179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf4deb-01c5-469d-a971-4fa2e804d5eb None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:29.956692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf4deb-01c5-469d-a971-4fa2e804d5eb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:29.956692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf4deb-01c5-469d-a971-4fa2e804d5eb None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:29.958007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 648/1302] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:46:29.963061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a157-4d0a-4489-b521-c573139e7eca None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:29.963428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a157-4d0a-4489-b521-c573139e7eca None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:29.963611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a157-4d0a-4489-b521-c573139e7eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:29.981651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6bb3a157-4d0a-4489-b521-c573139e7eca None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:46:29.982821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6bb3a157-4d0a-4489-b521-c573139e7eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:46:30.047853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 655/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:46:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:46:30.318266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf4deb-01c5-469d-a971-4fa2e804d5eb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:30.414508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:30.421739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf4deb-01c5-469d-a971-4fa2e804d5eb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:30.455087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:30.455698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:30.455974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:30.456243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:30.456820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:30.458217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:46:30.466803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:46:30.467921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application with Lock( Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: ERROR keystone.server.flask.application Sep 19 11:46:30.469055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 649/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Sep 19 11:46:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:46:30.474092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a157-4d0a-4489-b521-c573139e7eca None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:30.547639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:30.572999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a157-4d0a-4489-b521-c573139e7eca None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:30.606251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7525bf-6c48-4ab2-b74e-7d6f1420e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:30.606839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7525bf-6c48-4ab2-b74e-7d6f1420e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:30.607116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7525bf-6c48-4ab2-b74e-7d6f1420e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:30.607389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7525bf-6c48-4ab2-b74e-7d6f1420e2a0 None admin] PATH_INFO: `/v3/services` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:30.608013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7525bf-6c48-4ab2-b74e-7d6f1420e2a0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:46:30.608313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7525bf-6c48-4ab2-b74e-7d6f1420e2a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:30.609757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7525bf-6c48-4ab2-b74e-7d6f1420e2a0 None admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:30.614790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 656/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Sep 19 11:46:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:46:30.620605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:46:30.719521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319c372-5edc-4161-ab23-e782c8668f09 None admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:46:30.753051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801a5a6-d2d2-4977-bb07-d9ee428f7a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:46:30.753676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801a5a6-d2d2-4977-bb07-d9ee428f7a21 None admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:46:30.753952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801a5a6-d2d2-4977-bb07-d9ee428f7a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:46:30.754222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801a5a6-d2d2-4977-bb07-d9ee428f7a21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:46:30.754886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801a5a6-d2d2-4977-bb07-d9ee428f7a21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:46:30.756233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801a5a6-d2d2-4977-bb07-d9ee428f7a21 None admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:46:30.775085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 650/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:46:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:46:40.611886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=30 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:40.770935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:34.873957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08de69-4154-482a-86b9-aa022209da53 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:34.874475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08de69-4154-482a-86b9-aa022209da53 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:34.874475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08de69-4154-482a-86b9-aa022209da53 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:34.876551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 657/1307] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:34.881688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006278-bad6-47bb-b26c-9f0974dd8e14 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:34.882166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006278-bad6-47bb-b26c-9f0974dd8e14 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:34.882256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006278-bad6-47bb-b26c-9f0974dd8e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:35.010824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-64006278-bad6-47bb-b26c-9f0974dd8e14 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:35.013380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-64006278-bad6-47bb-b26c-9f0974dd8e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:35.157216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 651/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:35.451576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f191d-2a8c-4dd9-881b-f93b158066f3 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:35.451913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f191d-2a8c-4dd9-881b-f93b158066f3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:35.452128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f191d-2a8c-4dd9-881b-f93b158066f3 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:35.453628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 658/1309] 10.222.0.42 () {54 vars in 963 bytes} [Mon Sep 19 11:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:35.459827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130d7c-7b72-4d12-b34b-0290e32b5799 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:35.460115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130d7c-7b72-4d12-b34b-0290e32b5799 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:35.460390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130d7c-7b72-4d12-b34b-0290e32b5799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:35.541111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-73130d7c-7b72-4d12-b34b-0290e32b5799 None None] MFA Rules not processed for user `d84265ba2619438485db9a18f94c87aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:35.542399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-73130d7c-7b72-4d12-b34b-0290e32b5799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:35.566290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:35.628283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 652/1310] 10.222.0.42 () {58 vars in 1060 bytes} [Mon Sep 19 11:47:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:35.637398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f191d-2a8c-4dd9-881b-f93b158066f3 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:35.639067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-994f191d-2a8c-4dd9-881b-f93b158066f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:35.779365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f191d-2a8c-4dd9-881b-f93b158066f3 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:35.870965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109098c-9e24-4fd4-a358-546a2de8b255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:35.871698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109098c-9e24-4fd4-a358-546a2de8b255 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:35.872042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109098c-9e24-4fd4-a358-546a2de8b255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:35.872388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109098c-9e24-4fd4-a358-546a2de8b255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:35.874409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7109098c-9e24-4fd4-a358-546a2de8b255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:35.941656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:36.008886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109098c-9e24-4fd4-a358-546a2de8b255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:36.011959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109098c-9e24-4fd4-a358-546a2de8b255 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:36.036124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 659/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:47:38.543350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd28b5-7ce8-4296-87d7-83ca93a81648 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:38.543869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd28b5-7ce8-4296-87d7-83ca93a81648 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:38.543869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd28b5-7ce8-4296-87d7-83ca93a81648 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:38.545196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 653/1312] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:38.550540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e096b9-2850-4fc0-9fcd-0a7c1dd3cff4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:38.550963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e096b9-2850-4fc0-9fcd-0a7c1dd3cff4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:38.551073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e096b9-2850-4fc0-9fcd-0a7c1dd3cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:38.632029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f5e096b9-2850-4fc0-9fcd-0a7c1dd3cff4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:38.633251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f5e096b9-2850-4fc0-9fcd-0a7c1dd3cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:38.731291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 660/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:39.015810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd28b5-7ce8-4296-87d7-83ca93a81648 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:39.017385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-adbd28b5-7ce8-4296-87d7-83ca93a81648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:39.118856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd28b5-7ce8-4296-87d7-83ca93a81648 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:39.188134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:39.190189 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648fa25-0668-4583-8055-ea2e51b7de2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:39.190954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648fa25-0668-4583-8055-ea2e51b7de2c service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:39.191411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648fa25-0668-4583-8055-ea2e51b7de2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:39.191890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648fa25-0668-4583-8055-ea2e51b7de2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:39.193704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f648fa25-0668-4583-8055-ea2e51b7de2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:39.300388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648fa25-0668-4583-8055-ea2e51b7de2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:39.301742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648fa25-0668-4583-8055-ea2e51b7de2c service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:39.319779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 654/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:47:41.771539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98af1-854b-4656-88f3-8885582d4976 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:41.772068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98af1-854b-4656-88f3-8885582d4976 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:41.772161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98af1-854b-4656-88f3-8885582d4976 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:41.773498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 661/1315] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:41.778605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10068d6a-339f-4a65-9482-74106f66cee7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:41.779035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10068d6a-339f-4a65-9482-74106f66cee7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:41.779148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10068d6a-339f-4a65-9482-74106f66cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:41.844999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-10068d6a-339f-4a65-9482-74106f66cee7 None None] MFA Rules not processed for user `d47f075f137044fd9b08529f463da346`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:41.846268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-10068d6a-339f-4a65-9482-74106f66cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:41.896889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:41.941994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 655/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:42.227742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98af1-854b-4656-88f3-8885582d4976 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:42.229326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ffe98af1-854b-4656-88f3-8885582d4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:42.239522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:42.332841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98af1-854b-4656-88f3-8885582d4976 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:42.407338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4a5fe-2555-4bfe-ac9b-bf2985ca49d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:42.407928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a5fe-2555-4bfe-ac9b-bf2985ca49d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:42.408207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a5fe-2555-4bfe-ac9b-bf2985ca49d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:42.408474 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a5fe-2555-4bfe-ac9b-bf2985ca49d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:42.410094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-76d4a5fe-2555-4bfe-ac9b-bf2985ca49d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:42.472429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:42.518814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4a5fe-2555-4bfe-ac9b-bf2985ca49d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:42.520250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4a5fe-2555-4bfe-ac9b-bf2985ca49d8 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:42.538165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 662/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:47:45.247582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e30e-a840-4bda-bd8f-eb340f4cd0ef None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:45.248132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e30e-a840-4bda-bd8f-eb340f4cd0ef None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:45.248132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e30e-a840-4bda-bd8f-eb340f4cd0ef None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:45.249565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 656/1318] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:45.255078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f932-8302-4336-a54f-783343e3ea2d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:45.255453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f932-8302-4336-a54f-783343e3ea2d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:45.255628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004f932-8302-4336-a54f-783343e3ea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:45.320817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6004f932-8302-4336-a54f-783343e3ea2d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:45.322043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6004f932-8302-4336-a54f-783343e3ea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:45.420477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 663/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:45.708469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7e30e-a840-4bda-bd8f-eb340f4cd0ef None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:45.710042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1fa7e30e-a840-4bda-bd8f-eb340f4cd0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:45.813448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7e30e-a840-4bda-bd8f-eb340f4cd0ef None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:45.885360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0afc7-251a-4f17-a31b-701b98ea21a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:45.885952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0afc7-251a-4f17-a31b-701b98ea21a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:45.886236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0afc7-251a-4f17-a31b-701b98ea21a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:45.886504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0afc7-251a-4f17-a31b-701b98ea21a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:45.888082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8cb0afc7-251a-4f17-a31b-701b98ea21a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:45.894964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:45.995239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0afc7-251a-4f17-a31b-701b98ea21a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:45.996594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0afc7-251a-4f17-a31b-701b98ea21a6 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:46.014614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 657/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:47:48.846936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3aea8-52d6-492f-bdfe-909510c10dc0 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:48.847516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3aea8-52d6-492f-bdfe-909510c10dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:48.847516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3aea8-52d6-492f-bdfe-909510c10dc0 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:48.848822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 664/1321] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:48.854137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f4a1-3943-49fb-8a6b-0fbebd100a64 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:48.854555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f4a1-3943-49fb-8a6b-0fbebd100a64 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:48.854689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f4a1-3943-49fb-8a6b-0fbebd100a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:48.929549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2c75f4a1-3943-49fb-8a6b-0fbebd100a64 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:48.930697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2c75f4a1-3943-49fb-8a6b-0fbebd100a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:48.995672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:49.038454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 658/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:49.328432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3aea8-52d6-492f-bdfe-909510c10dc0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:49.329985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4ec3aea8-52d6-492f-bdfe-909510c10dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:49.351010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:49.435505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3aea8-52d6-492f-bdfe-909510c10dc0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:49.510677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242bb8b-a8cc-470e-8238-f6962f0b4b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:49.511285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242bb8b-a8cc-470e-8238-f6962f0b4b38 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:49.511563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242bb8b-a8cc-470e-8238-f6962f0b4b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:49.511832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242bb8b-a8cc-470e-8238-f6962f0b4b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:49.513599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b242bb8b-a8cc-470e-8238-f6962f0b4b38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:49.586571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:49.626000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242bb8b-a8cc-470e-8238-f6962f0b4b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:49.627416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242bb8b-a8cc-470e-8238-f6962f0b4b38 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:49.646645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 665/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:47:51.863432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af4c38-913c-40e9-acef-e41e31de1156 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:51.863958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af4c38-913c-40e9-acef-e41e31de1156 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:51.863958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af4c38-913c-40e9-acef-e41e31de1156 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:51.865393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 659/1324] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:51.870780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0876499-c663-4310-aee3-ba154595c827 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:51.871188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0876499-c663-4310-aee3-ba154595c827 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:51.871332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0876499-c663-4310-aee3-ba154595c827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:51.936654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e0876499-c663-4310-aee3-ba154595c827 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:51.937839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e0876499-c663-4310-aee3-ba154595c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:52.039496 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 666/1325] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:52.317999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af4c38-913c-40e9-acef-e41e31de1156 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:52.319588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-31af4c38-913c-40e9-acef-e41e31de1156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:52.426980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af4c38-913c-40e9-acef-e41e31de1156 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:52.502609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731d914-e797-44e4-a398-26414452c72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:52.503127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d914-e797-44e4-a398-26414452c72c service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:52.503403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d914-e797-44e4-a398-26414452c72c service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:52.503676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d914-e797-44e4-a398-26414452c72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:52.505291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d731d914-e797-44e4-a398-26414452c72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:52.524679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:52.620926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731d914-e797-44e4-a398-26414452c72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:52.622424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731d914-e797-44e4-a398-26414452c72c service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:52.641314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 660/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:47:54.869982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb703-7026-4196-8333-06069eb581ce None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:54.870491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb703-7026-4196-8333-06069eb581ce None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:54.870491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb703-7026-4196-8333-06069eb581ce None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:54.871807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 667/1327] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:54.877400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b25d4-7496-432a-a300-f5a3a51ac0ca None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:54.877806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b25d4-7496-432a-a300-f5a3a51ac0ca None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:54.877944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b25d4-7496-432a-a300-f5a3a51ac0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:54.946193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-567b25d4-7496-432a-a300-f5a3a51ac0ca None None] MFA Rules not processed for user `d47f075f137044fd9b08529f463da346`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:54.947040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-567b25d4-7496-432a-a300-f5a3a51ac0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:55.012473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:55.045096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 661/1328] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:55.329970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb703-7026-4196-8333-06069eb581ce None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:55.331496 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-14ccb703-7026-4196-8333-06069eb581ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:55.364556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:55.441887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb703-7026-4196-8333-06069eb581ce None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:55.518169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ab6a4-6357-4eb5-8374-359f829767de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:55.519104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab6a4-6357-4eb5-8374-359f829767de service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:55.519394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab6a4-6357-4eb5-8374-359f829767de service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:55.519662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab6a4-6357-4eb5-8374-359f829767de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:55.521315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ca8ab6a4-6357-4eb5-8374-359f829767de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:55.605919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:55.638795 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ab6a4-6357-4eb5-8374-359f829767de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:55.640282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ab6a4-6357-4eb5-8374-359f829767de service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:55.658898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 668/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:47:58.066349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043040d-7bdf-4dd6-8b1a-5c0f26c8d4dc None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:58.066881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043040d-7bdf-4dd6-8b1a-5c0f26c8d4dc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:58.066881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043040d-7bdf-4dd6-8b1a-5c0f26c8d4dc None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:58.068232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 662/1330] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:58.073539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073800-b47e-49c8-8450-04bf05546497 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:58.073940 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073800-b47e-49c8-8450-04bf05546497 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:58.074095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073800-b47e-49c8-8450-04bf05546497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:58.139843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5d073800-b47e-49c8-8450-04bf05546497 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:58.141852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5d073800-b47e-49c8-8450-04bf05546497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:58.236529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 669/1331] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:47:58.535007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb63ea-b805-42ab-8d79-3a8f48bcb0e3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:58.535287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb63ea-b805-42ab-8d79-3a8f48bcb0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:58.535562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb63ea-b805-42ab-8d79-3a8f48bcb0e3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:58.536917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 663/1332] 10.222.0.42 () {54 vars in 963 bytes} [Mon Sep 19 11:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:47:58.542731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05650f5-f4c9-4f40-a4ac-6118beb15a72 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:58.543012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05650f5-f4c9-4f40-a4ac-6118beb15a72 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:58.543283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05650f5-f4c9-4f40-a4ac-6118beb15a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:58.589523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:58.621663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e05650f5-f4c9-4f40-a4ac-6118beb15a72 None None] MFA Rules not processed for user `d84265ba2619438485db9a18f94c87aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:47:58.622879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e05650f5-f4c9-4f40-a4ac-6118beb15a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:58.699646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 670/1333] 10.222.0.42 () {58 vars in 1060 bytes} [Mon Sep 19 11:47:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:47:58.708723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb63ea-b805-42ab-8d79-3a8f48bcb0e3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:47:58.710285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-afcb63ea-b805-42ab-8d79-3a8f48bcb0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:58.813649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb63ea-b805-42ab-8d79-3a8f48bcb0e3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:47:58.887296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc43be-aa50-4734-abb7-886194eee9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:47:58.887810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc43be-aa50-4734-abb7-886194eee9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:47:58.888087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc43be-aa50-4734-abb7-886194eee9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:47:58.888356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc43be-aa50-4734-abb7-886194eee9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:47:58.890061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6cfc43be-aa50-4734-abb7-886194eee9d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:47:58.917163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:59.000084 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc43be-aa50-4734-abb7-886194eee9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:47:59.002047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc43be-aa50-4734-abb7-886194eee9d4 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:47:59.022806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 664/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:01.442357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010148-6ce5-4a6e-a88f-f2effcc9b890 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:01.442871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010148-6ce5-4a6e-a88f-f2effcc9b890 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:01.442966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010148-6ce5-4a6e-a88f-f2effcc9b890 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:01.444242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 671/1335] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:01.449606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d123-b0e5-4135-b5cd-cabdff576e23 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:01.450023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d123-b0e5-4135-b5cd-cabdff576e23 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:01.450167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d123-b0e5-4135-b5cd-cabdff576e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:01.517059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a297d123-b0e5-4135-b5cd-cabdff576e23 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:01.518298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a297d123-b0e5-4135-b5cd-cabdff576e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:01.592174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:01.615705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 665/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:01.904125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db010148-6ce5-4a6e-a88f-f2effcc9b890 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:01.906219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db010148-6ce5-4a6e-a88f-f2effcc9b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:02.010468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db010148-6ce5-4a6e-a88f-f2effcc9b890 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:02.038890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:02.083795 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1780cc-4a5c-41e2-bb97-dfb0ac5c107f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:02.084389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1780cc-4a5c-41e2-bb97-dfb0ac5c107f service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:02.084670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1780cc-4a5c-41e2-bb97-dfb0ac5c107f service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:02.084939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1780cc-4a5c-41e2-bb97-dfb0ac5c107f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:02.086631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3c1780cc-4a5c-41e2-bb97-dfb0ac5c107f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:02.195353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1780cc-4a5c-41e2-bb97-dfb0ac5c107f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:02.196690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1780cc-4a5c-41e2-bb97-dfb0ac5c107f service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:02.214857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 672/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:05.143294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028f213-f517-4c2b-bdad-619da435c5aa None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:05.143886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028f213-f517-4c2b-bdad-619da435c5aa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:05.143886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028f213-f517-4c2b-bdad-619da435c5aa None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:05.145198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 666/1338] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:05.150478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa282-a357-4f7c-86c2-928d7e2fb449 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:05.150928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa282-a357-4f7c-86c2-928d7e2fb449 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:05.151029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa282-a357-4f7c-86c2-928d7e2fb449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:05.219127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-945fa282-a357-4f7c-86c2-928d7e2fb449 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:05.220321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-945fa282-a357-4f7c-86c2-928d7e2fb449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:05.228487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:05.315212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 673/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:05.599180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028f213-f517-4c2b-bdad-619da435c5aa None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:05.600708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3028f213-f517-4c2b-bdad-619da435c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:05.704659 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028f213-f517-4c2b-bdad-619da435c5aa None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:05.779302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648dda4-44ef-4b60-a04d-40286a5639c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:05.779901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648dda4-44ef-4b60-a04d-40286a5639c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:05.780178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648dda4-44ef-4b60-a04d-40286a5639c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:05.780447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648dda4-44ef-4b60-a04d-40286a5639c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:05.782117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b648dda4-44ef-4b60-a04d-40286a5639c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:05.817699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:05.892922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648dda4-44ef-4b60-a04d-40286a5639c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:05.894409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648dda4-44ef-4b60-a04d-40286a5639c4 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:05.912681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 667/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:09.976203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ba2c4-bd1e-44f3-a2af-eb41b44db4a7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:09.978392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ba2c4-bd1e-44f3-a2af-eb41b44db4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:09.978982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ba2c4-bd1e-44f3-a2af-eb41b44db4a7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:09.981451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 674/1341] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:48:09.987955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c7bb-3c65-481e-8f86-a5dae96d3e11 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:09.988385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c7bb-3c65-481e-8f86-a5dae96d3e11 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:09.988560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c7bb-3c65-481e-8f86-a5dae96d3e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:10.055500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c260c7bb-3c65-481e-8f86-a5dae96d3e11 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:10.056705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c260c7bb-3c65-481e-8f86-a5dae96d3e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:10.147816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:10.161335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 668/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:48:10.446488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ba2c4-bd1e-44f3-a2af-eb41b44db4a7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:10.448023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b25ba2c4-bd1e-44f3-a2af-eb41b44db4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:10.553596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ba2c4-bd1e-44f3-a2af-eb41b44db4a7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:10.592547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:10.629757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac91587-fa07-4ee4-b25f-e059b1eb6dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:10.630413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac91587-fa07-4ee4-b25f-e059b1eb6dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:10.630689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac91587-fa07-4ee4-b25f-e059b1eb6dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:10.630955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac91587-fa07-4ee4-b25f-e059b1eb6dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:10.632519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8ac91587-fa07-4ee4-b25f-e059b1eb6dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:10.745318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac91587-fa07-4ee4-b25f-e059b1eb6dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:10.746668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac91587-fa07-4ee4-b25f-e059b1eb6dd2 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:10.765394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 675/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:13.686333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706c92a-2e74-436e-89a6-c615134f5ac9 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:13.686890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706c92a-2e74-436e-89a6-c615134f5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:13.686999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706c92a-2e74-436e-89a6-c615134f5ac9 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:13.688330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 669/1344] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:13.693697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567312c-b7ad-4fbd-9d21-e723b037fe43 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:13.694128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567312c-b7ad-4fbd-9d21-e723b037fe43 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:13.694226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567312c-b7ad-4fbd-9d21-e723b037fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:13.761548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0567312c-b7ad-4fbd-9d21-e723b037fe43 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:13.762744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0567312c-b7ad-4fbd-9d21-e723b037fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:13.782481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:13.868137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 676/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:14.152831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706c92a-2e74-436e-89a6-c615134f5ac9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:14.154474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8706c92a-2e74-436e-89a6-c615134f5ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:14.263334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706c92a-2e74-436e-89a6-c615134f5ac9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:14.336475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74856a6c-c913-43b4-bb87-0a71d2fc025e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:14.336993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856a6c-c913-43b4-bb87-0a71d2fc025e service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:14.337303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856a6c-c913-43b4-bb87-0a71d2fc025e service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:14.337574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856a6c-c913-43b4-bb87-0a71d2fc025e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:14.339146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-74856a6c-c913-43b4-bb87-0a71d2fc025e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:14.390978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:14.458986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74856a6c-c913-43b4-bb87-0a71d2fc025e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:14.460429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74856a6c-c913-43b4-bb87-0a71d2fc025e service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:14.479100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 670/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:18.852040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064c35-146e-4a37-84fa-8cd196c9ea67 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:18.852518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064c35-146e-4a37-84fa-8cd196c9ea67 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:18.852616 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064c35-146e-4a37-84fa-8cd196c9ea67 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:18.853998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 677/1347] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:18.860415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a353864-4f29-4b8e-8fce-8fb5ea96cbbb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:18.860902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a353864-4f29-4b8e-8fce-8fb5ea96cbbb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:18.860996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a353864-4f29-4b8e-8fce-8fb5ea96cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:18.933104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0a353864-4f29-4b8e-8fce-8fb5ea96cbbb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:18.934346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0a353864-4f29-4b8e-8fce-8fb5ea96cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:19.030238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:19.032595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 671/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:19.324597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064c35-146e-4a37-84fa-8cd196c9ea67 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:19.326193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-41064c35-146e-4a37-84fa-8cd196c9ea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:19.430991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064c35-146e-4a37-84fa-8cd196c9ea67 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:19.481042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:19.507404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1846-33f6-432e-9205-3947f5cc06c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:19.508118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1846-33f6-432e-9205-3947f5cc06c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:19.508399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1846-33f6-432e-9205-3947f5cc06c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:19.508669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1846-33f6-432e-9205-3947f5cc06c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:19.510300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f3cf1846-33f6-432e-9205-3947f5cc06c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:19.618196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1846-33f6-432e-9205-3947f5cc06c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:19.619538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1846-33f6-432e-9205-3947f5cc06c1 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:19.637735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 678/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:24.599272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ee26-e07e-432a-8066-5ead4c1c6ae6 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:24.600074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ee26-e07e-432a-8066-5ead4c1c6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:24.600353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ee26-e07e-432a-8066-5ead4c1c6ae6 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:24.602949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 672/1350] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:24.607915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9814b9-c15c-418c-8e36-7eedb5db8d09 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:24.608736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9814b9-c15c-418c-8e36-7eedb5db8d09 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:24.609341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9814b9-c15c-418c-8e36-7eedb5db8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:24.747147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9c9814b9-c15c-418c-8e36-7eedb5db8d09 None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:24.748551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9c9814b9-c15c-418c-8e36-7eedb5db8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:24.774149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:24.882649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 679/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:29.182502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1bc58-f7c9-4534-a153-6cc38cd74476 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:29.183035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1bc58-f7c9-4534-a153-6cc38cd74476 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:29.183035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1bc58-f7c9-4534-a153-6cc38cd74476 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:29.184538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 673/1352] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:48:29.189474 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae76e7-b014-4b13-a00b-510fab7c41ca None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:29.189937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae76e7-b014-4b13-a00b-510fab7c41ca None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:29.190244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae76e7-b014-4b13-a00b-510fab7c41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:29.274162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e7ae76e7-b014-4b13-a00b-510fab7c41ca None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:29.275424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e7ae76e7-b014-4b13-a00b-510fab7c41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:29.360394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:29.399163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 680/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:48:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:30.590595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f9730-a24a-46fc-9a07-b22dd51c37c3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:30.591141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f9730-a24a-46fc-9a07-b22dd51c37c3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:30.591141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f9730-a24a-46fc-9a07-b22dd51c37c3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:30.592482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 674/1354] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:30.598313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9482c16-7500-4a82-bfcc-af71341a00ed None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:30.598781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9482c16-7500-4a82-bfcc-af71341a00ed None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:30.598920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9482c16-7500-4a82-bfcc-af71341a00ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:30.682073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c9482c16-7500-4a82-bfcc-af71341a00ed None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:30.683212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c9482c16-7500-4a82-bfcc-af71341a00ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:30.792895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 681/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:34.346971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcff60-d3e4-4b7f-b17d-40ebd6ad42a3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:34.347493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcff60-d3e4-4b7f-b17d-40ebd6ad42a3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:34.347493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcff60-d3e4-4b7f-b17d-40ebd6ad42a3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:34.348884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 675/1356] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:34.354288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c29be-e505-4b88-91a5-68fce51d75b5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:34.354734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c29be-e505-4b88-91a5-68fce51d75b5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:34.354826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c29be-e505-4b88-91a5-68fce51d75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:34.394729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:34.425939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2f7c29be-e505-4b88-91a5-68fce51d75b5 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:34.427044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2f7c29be-e505-4b88-91a5-68fce51d75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:34.531065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 682/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:48:34.831776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4d2d-6a6b-4c38-969a-fa9ad20695ce None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:34.832060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4d2d-6a6b-4c38-969a-fa9ad20695ce None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:34.832336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4d2d-6a6b-4c38-969a-fa9ad20695ce None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:34.834223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 676/1358] 10.222.0.42 () {54 vars in 965 bytes} [Mon Sep 19 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:34.842068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25230c-ac7a-4957-a33c-045d7f4c3e9a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:34.842686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25230c-ac7a-4957-a33c-045d7f4c3e9a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:34.843168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25230c-ac7a-4957-a33c-045d7f4c3e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:34.953056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-de25230c-ac7a-4957-a33c-045d7f4c3e9a None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:34.954985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-de25230c-ac7a-4957-a33c-045d7f4c3e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:35.006139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:35.108774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 683/1359] 10.222.0.42 () {58 vars in 1062 bytes} [Mon Sep 19 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:48:35.116694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4d2d-6a6b-4c38-969a-fa9ad20695ce None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:35.118420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-eb9d4d2d-6a6b-4c38-969a-fa9ad20695ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:35.289423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4d2d-6a6b-4c38-969a-fa9ad20695ce None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:35.369295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:35.412968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4746f2-3dfa-469a-b1ce-30c0aa7df3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:35.413652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4746f2-3dfa-469a-b1ce-30c0aa7df3f7 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:35.413932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4746f2-3dfa-469a-b1ce-30c0aa7df3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:35.414201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4746f2-3dfa-469a-b1ce-30c0aa7df3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:35.415986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4d4746f2-3dfa-469a-b1ce-30c0aa7df3f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:35.524224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4746f2-3dfa-469a-b1ce-30c0aa7df3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:35.526060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4746f2-3dfa-469a-b1ce-30c0aa7df3f7 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:35.545004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 677/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:38.088553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954f54-103a-4e06-99e2-bdd4d374f16e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:38.089015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954f54-103a-4e06-99e2-bdd4d374f16e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:38.089682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954f54-103a-4e06-99e2-bdd4d374f16e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:38.091032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 684/1361] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:38.097484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdbb52-44f9-4489-add6-c78b41e9a728 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:38.097939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdbb52-44f9-4489-add6-c78b41e9a728 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:38.098030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdbb52-44f9-4489-add6-c78b41e9a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:38.166988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-abcdbb52-44f9-4489-add6-c78b41e9a728 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:38.168202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-abcdbb52-44f9-4489-add6-c78b41e9a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:38.209376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:38.275213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 678/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:38.573300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954f54-103a-4e06-99e2-bdd4d374f16e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:38.574894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-74954f54-103a-4e06-99e2-bdd4d374f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:38.775020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954f54-103a-4e06-99e2-bdd4d374f16e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:38.784569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:38.899255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b909ba0-ebc4-4492-baab-91147ed95261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:38.899773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909ba0-ebc4-4492-baab-91147ed95261 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:38.900047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909ba0-ebc4-4492-baab-91147ed95261 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:38.900312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b909ba0-ebc4-4492-baab-91147ed95261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:38.901937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3b909ba0-ebc4-4492-baab-91147ed95261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:38.998777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b909ba0-ebc4-4492-baab-91147ed95261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:39.001306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b909ba0-ebc4-4492-baab-91147ed95261 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:39.019992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 685/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:41.523189 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24334b44-c0a4-4d63-b376-8e06301166b4 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:41.524087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24334b44-c0a4-4d63-b376-8e06301166b4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:41.524599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24334b44-c0a4-4d63-b376-8e06301166b4 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:41.526211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 679/1364] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:41.532265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e2cb6-070d-46b5-87e6-cf4e28b8b82c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:41.533135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e2cb6-070d-46b5-87e6-cf4e28b8b82c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:41.533673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e2cb6-070d-46b5-87e6-cf4e28b8b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:41.550110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:41.607340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c95e2cb6-070d-46b5-87e6-cf4e28b8b82c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:41.609386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c95e2cb6-070d-46b5-87e6-cf4e28b8b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:41.725508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 686/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:42.023853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b869f-0b2b-4713-910b-b6459970ec49 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:42.024210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b869f-0b2b-4713-910b-b6459970ec49 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:42.024633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b869f-0b2b-4713-910b-b6459970ec49 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:42.026293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 680/1366] 10.222.0.42 () {54 vars in 965 bytes} [Mon Sep 19 11:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:42.032121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab787d9f-e1d3-49a2-9ccd-bada5d814d11 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:42.032533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab787d9f-e1d3-49a2-9ccd-bada5d814d11 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:42.032815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab787d9f-e1d3-49a2-9ccd-bada5d814d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:42.114024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ab787d9f-e1d3-49a2-9ccd-bada5d814d11 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:42.115206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ab787d9f-e1d3-49a2-9ccd-bada5d814d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:42.152272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:42.245312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 687/1367] 10.222.0.42 () {58 vars in 1062 bytes} [Mon Sep 19 11:48:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:42.251689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b869f-0b2b-4713-910b-b6459970ec49 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:42.253374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0c9b869f-0b2b-4713-910b-b6459970ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:42.415762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b869f-0b2b-4713-910b-b6459970ec49 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:42.436926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:42.542277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a409-7fda-43ce-b967-c507cff3d67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:42.542946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a409-7fda-43ce-b967-c507cff3d67e service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:42.543184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a409-7fda-43ce-b967-c507cff3d67e service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:42.543353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a409-7fda-43ce-b967-c507cff3d67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:42.545039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a0e8a409-7fda-43ce-b967-c507cff3d67e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:42.654800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a409-7fda-43ce-b967-c507cff3d67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:42.656644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4374df-424f-4d79-a3db-8f52fb137047 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:42.656644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4374df-424f-4d79-a3db-8f52fb137047 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:42.657177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4374df-424f-4d79-a3db-8f52fb137047 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:42.657354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a409-7fda-43ce-b967-c507cff3d67e service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:42.658271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 688/1368] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:42.663548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f744b9-a226-4824-a960-c11fbe1c5a4a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:42.663875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f744b9-a226-4824-a960-c11fbe1c5a4a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:42.664155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f744b9-a226-4824-a960-c11fbe1c5a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:42.680451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 681/1369] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:42.743104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-93f744b9-a226-4824-a960-c11fbe1c5a4a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:42.744461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-93f744b9-a226-4824-a960-c11fbe1c5a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:42.855997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:42.866222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 689/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:43.201253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7321f9-e419-41aa-93f2-ca42149b843f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:43.201636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7321f9-e419-41aa-93f2-ca42149b843f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:43.202006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7321f9-e419-41aa-93f2-ca42149b843f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:43.203805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 682/1371] 10.222.0.42 () {54 vars in 967 bytes} [Mon Sep 19 11:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:43.208872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce27c1-744c-484c-af4b-b2a32665de40 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:43.209314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce27c1-744c-484c-af4b-b2a32665de40 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:43.209691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce27c1-744c-484c-af4b-b2a32665de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:43.292380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d3ce27c1-744c-484c-af4b-b2a32665de40 None None] MFA Rules not processed for user `a82e9cce21e2452ca7977b828a137c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:43.293685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d3ce27c1-744c-484c-af4b-b2a32665de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:43.379962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 690/1372] 10.222.0.42 () {58 vars in 1064 bytes} [Mon Sep 19 11:48:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:43.387624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7321f9-e419-41aa-93f2-ca42149b843f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:43.389336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dd7321f9-e419-41aa-93f2-ca42149b843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:43.419677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:43.502678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7321f9-e419-41aa-93f2-ca42149b843f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:43.584411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60893c-9b25-47be-abe3-3d1fd69cc105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:43.585449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60893c-9b25-47be-abe3-3d1fd69cc105 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:43.585586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60893c-9b25-47be-abe3-3d1fd69cc105 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:43.585952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60893c-9b25-47be-abe3-3d1fd69cc105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:43.587648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3b60893c-9b25-47be-abe3-3d1fd69cc105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:43.695922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:43.741728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60893c-9b25-47be-abe3-3d1fd69cc105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:43.743879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60893c-9b25-47be-abe3-3d1fd69cc105 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:43.766446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 683/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:48:44.954048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87607cd-ec4e-4389-8f9e-a4a54a0fbb97 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:44.954568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87607cd-ec4e-4389-8f9e-a4a54a0fbb97 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:44.954568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87607cd-ec4e-4389-8f9e-a4a54a0fbb97 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:44.955863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 691/1374] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:48:44.961285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94215f-d5e7-4fa2-a53b-b7c4cd5ceca0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:44.961748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94215f-d5e7-4fa2-a53b-b7c4cd5ceca0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:44.961861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94215f-d5e7-4fa2-a53b-b7c4cd5ceca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:45.028504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2a94215f-d5e7-4fa2-a53b-b7c4cd5ceca0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:45.029723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2a94215f-d5e7-4fa2-a53b-b7c4cd5ceca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:45.128235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 684/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:48:45.424473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87607cd-ec4e-4389-8f9e-a4a54a0fbb97 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:45.426054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e87607cd-ec4e-4389-8f9e-a4a54a0fbb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:45.513566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:45.576084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87607cd-ec4e-4389-8f9e-a4a54a0fbb97 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:45.698928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53990b1a-46cf-4e71-8302-ee4be670ccf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:45.699540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990b1a-46cf-4e71-8302-ee4be670ccf6 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:45.699818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990b1a-46cf-4e71-8302-ee4be670ccf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:45.700088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53990b1a-46cf-4e71-8302-ee4be670ccf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:45.701714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-53990b1a-46cf-4e71-8302-ee4be670ccf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:45.755923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:45.799753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53990b1a-46cf-4e71-8302-ee4be670ccf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:45.801379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53990b1a-46cf-4e71-8302-ee4be670ccf6 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:45.819817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 692/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:48.063410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972476-8f90-4804-8cfb-41f8eb1d6b3d None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:48.063981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972476-8f90-4804-8cfb-41f8eb1d6b3d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:48.063981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972476-8f90-4804-8cfb-41f8eb1d6b3d None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:48.065336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 685/1377] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:48.070916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b08d-3273-4d2e-8482-c4b2e700c3f1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:48.071376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b08d-3273-4d2e-8482-c4b2e700c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:48.071479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b08d-3273-4d2e-8482-c4b2e700c3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:48.146471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d477b08d-3273-4d2e-8482-c4b2e700c3f1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:48.147671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d477b08d-3273-4d2e-8482-c4b2e700c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:48.251186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 693/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:48.543397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972476-8f90-4804-8cfb-41f8eb1d6b3d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:48.545101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cd972476-8f90-4804-8cfb-41f8eb1d6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:48.585762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:48.709017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972476-8f90-4804-8cfb-41f8eb1d6b3d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:48.822354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:48.829221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d43ee-b09c-4bae-856c-16815e41a022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:48.830235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d43ee-b09c-4bae-856c-16815e41a022 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:48.830614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d43ee-b09c-4bae-856c-16815e41a022 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:48.831010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d43ee-b09c-4bae-856c-16815e41a022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:48.832689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-282d43ee-b09c-4bae-856c-16815e41a022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:48.930794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d43ee-b09c-4bae-856c-16815e41a022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:48.932570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d43ee-b09c-4bae-856c-16815e41a022 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:48.951855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 686/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:51.188210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c871-2ec2-4593-bf85-e56f47ae8e0a None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:51.188661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c871-2ec2-4593-bf85-e56f47ae8e0a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:51.188761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c871-2ec2-4593-bf85-e56f47ae8e0a None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:51.193199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 694/1380] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:51.196679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a280c0-3060-4a6b-a64f-5a263ff116b0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:51.197260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a280c0-3060-4a6b-a64f-5a263ff116b0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:51.198529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a280c0-3060-4a6b-a64f-5a263ff116b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:51.313393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-71a280c0-3060-4a6b-a64f-5a263ff116b0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:51.314647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-71a280c0-3060-4a6b-a64f-5a263ff116b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:51.396344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:51.429303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 687/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:51.725206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235c871-2ec2-4593-bf85-e56f47ae8e0a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:51.726718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e235c871-2ec2-4593-bf85-e56f47ae8e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:51.756657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:51.882285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235c871-2ec2-4593-bf85-e56f47ae8e0a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:51.990454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:52.010897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995514bc-3afb-4e07-807b-01de8f1f19a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:52.011654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995514bc-3afb-4e07-807b-01de8f1f19a0 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:52.012002 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995514bc-3afb-4e07-807b-01de8f1f19a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:52.012350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995514bc-3afb-4e07-807b-01de8f1f19a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:52.014516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-995514bc-3afb-4e07-807b-01de8f1f19a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:52.125683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995514bc-3afb-4e07-807b-01de8f1f19a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:52.127292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995514bc-3afb-4e07-807b-01de8f1f19a0 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:52.146516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 695/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:54.358141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0bbe-1702-4f93-bfc9-68cb4c42cbbd None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:54.359529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0bbe-1702-4f93-bfc9-68cb4c42cbbd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:54.359925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0bbe-1702-4f93-bfc9-68cb4c42cbbd None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:54.361901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 688/1383] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:54.367111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a832-c485-40f5-a4b7-ca7cd9acdbfa None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:54.367516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a832-c485-40f5-a4b7-ca7cd9acdbfa None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:54.367662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a832-c485-40f5-a4b7-ca7cd9acdbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:54.435713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3789a832-c485-40f5-a4b7-ca7cd9acdbfa None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:54.437108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3789a832-c485-40f5-a4b7-ca7cd9acdbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:54.503434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:54.548791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 696/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:54.836962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0bbe-1702-4f93-bfc9-68cb4c42cbbd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:54.838517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b63c0bbe-1702-4f93-bfc9-68cb4c42cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:54.991242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0bbe-1702-4f93-bfc9-68cb4c42cbbd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:55.058939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:55.126079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae7a50-dada-4ced-aa12-d5cc2b995d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:55.126600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae7a50-dada-4ced-aa12-d5cc2b995d08 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:55.126877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae7a50-dada-4ced-aa12-d5cc2b995d08 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:55.127150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae7a50-dada-4ced-aa12-d5cc2b995d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:55.128748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2aae7a50-dada-4ced-aa12-d5cc2b995d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:55.221370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae7a50-dada-4ced-aa12-d5cc2b995d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:55.222992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae7a50-dada-4ced-aa12-d5cc2b995d08 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:55.243805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 689/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:57.802237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f9e4-caa1-4b27-884b-d74a4ed33859 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:57.802798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f9e4-caa1-4b27-884b-d74a4ed33859 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:57.802798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f9e4-caa1-4b27-884b-d74a4ed33859 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:57.804145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 697/1386] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:57.809969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141f10-c97d-4339-a7f8-cef34925ee41 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:57.810499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141f10-c97d-4339-a7f8-cef34925ee41 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:57.810499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141f10-c97d-4339-a7f8-cef34925ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:57.879604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1f141f10-c97d-4339-a7f8-cef34925ee41 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:57.880808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1f141f10-c97d-4339-a7f8-cef34925ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:57.889192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:57.978770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 690/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:58.271426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f9e4-caa1-4b27-884b-d74a4ed33859 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:58.273131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6262f9e4-caa1-4b27-884b-d74a4ed33859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:58.421680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f9e4-caa1-4b27-884b-d74a4ed33859 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:58.467626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:58.538413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238b093-5408-4e10-974e-bf862169adb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:58.538935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238b093-5408-4e10-974e-bf862169adb8 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:58.539216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238b093-5408-4e10-974e-bf862169adb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:58.539486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238b093-5408-4e10-974e-bf862169adb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:58.541088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d238b093-5408-4e10-974e-bf862169adb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:58.634168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238b093-5408-4e10-974e-bf862169adb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:58.635776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238b093-5408-4e10-974e-bf862169adb8 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:58.658819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 698/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:48:59.100762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a589-4e31-4e61-a67c-d08971e2bcc2 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:59.101350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a589-4e31-4e61-a67c-d08971e2bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:59.101350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a589-4e31-4e61-a67c-d08971e2bcc2 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:59.102672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 691/1389] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:59.107870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c069-43ca-4899-9cc7-cd2ec89cadf2 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:59.108263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c069-43ca-4899-9cc7-cd2ec89cadf2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:59.109434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c069-43ca-4899-9cc7-cd2ec89cadf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:59.173704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:59.176822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-32b0c069-43ca-4899-9cc7-cd2ec89cadf2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:59.178674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-32b0c069-43ca-4899-9cc7-cd2ec89cadf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:59.278089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 699/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:59.590309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44ccc-bcb9-4288-82dc-dad3394867dc None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:59.590588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44ccc-bcb9-4288-82dc-dad3394867dc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:59.590859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44ccc-bcb9-4288-82dc-dad3394867dc None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:59.592263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 692/1391] 10.222.0.42 () {54 vars in 962 bytes} [Mon Sep 19 11:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:48:59.598112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb576527-2696-45d9-9399-c7d2ba1dd54d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:59.598395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb576527-2696-45d9-9399-c7d2ba1dd54d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:59.598664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb576527-2696-45d9-9399-c7d2ba1dd54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:59.676942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bb576527-2696-45d9-9399-c7d2ba1dd54d None None] MFA Rules not processed for user `f951f4e6a8e5407580ec1ead59fdeec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:48:59.678207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bb576527-2696-45d9-9399-c7d2ba1dd54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:59.749778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:59.756566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 700/1392] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Sep 19 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:48:59.766429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44ccc-bcb9-4288-82dc-dad3394867dc None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:59.767967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1db44ccc-bcb9-4288-82dc-dad3394867dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:59.871146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44ccc-bcb9-4288-82dc-dad3394867dc None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:59.910415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:59.948186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1ed82-9739-4557-94c4-4254253e6e2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:59.948785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1ed82-9739-4557-94c4-4254253e6e2e service glance] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:59.949056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1ed82-9739-4557-94c4-4254253e6e2e service glance] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:59.949352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1ed82-9739-4557-94c4-4254253e6e2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:59.951041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cef1ed82-9739-4557-94c4-4254253e6e2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:00.063470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1ed82-9739-4557-94c4-4254253e6e2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:00.064899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1ed82-9739-4557-94c4-4254253e6e2e service glance] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:00.083467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 693/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:00.861490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cfdeb-2d74-4c92-b4bd-02bd55e8d5fa None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:00.861991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cfdeb-2d74-4c92-b4bd-02bd55e8d5fa None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:00.862192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cfdeb-2d74-4c92-b4bd-02bd55e8d5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:00.910433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460140-b354-495a-bfd6-99b0c3d4e667 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:00.911011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460140-b354-495a-bfd6-99b0c3d4e667 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:00.911011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460140-b354-495a-bfd6-99b0c3d4e667 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:00.912492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 694/1394] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:49:00.917406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:00.917679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:00.917952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:00.932756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a61cfdeb-2d74-4c92-b4bd-02bd55e8d5fa None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:00.934838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a61cfdeb-2d74-4c92-b4bd-02bd55e8d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:00.987371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:00.988588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:01.007374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:01.036842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 701/1395] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:01.083894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e51e6-0165-4ddc-9ed7-63ed33f614db None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:01.084178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e51e6-0165-4ddc-9ed7-63ed33f614db None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:01.084451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e51e6-0165-4ddc-9ed7-63ed33f614db None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:01.085850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 702/1396] 10.222.0.42 () {54 vars in 943 bytes} [Mon Sep 19 11:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:49:01.092019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:01.092306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:01.092581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:01.094200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 695/1397] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:49:01.173371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] MFA Rules not processed for user `982dd41852574cd0a7db4184da3141ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:01.174526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:01.203484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:01.285210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 703/1398] 10.222.0.42 () {58 vars in 1040 bytes} [Mon Sep 19 11:49:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:49:01.295032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:01.297207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:01.391541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:01.392986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:01.408859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79416a-0675-4098-af3a-f0756cd2eb0b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:01.463602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:01.501482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706754-fa6a-40bb-8ba2-542db9cbfa53 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:01.520411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc545-3c3a-45d7-979f-04df6d1ae54d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:01.521015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc545-3c3a-45d7-979f-04df6d1ae54d service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:01.521317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc545-3c3a-45d7-979f-04df6d1ae54d service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:01.521595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc545-3c3a-45d7-979f-04df6d1ae54d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:01.523209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-264cc545-3c3a-45d7-979f-04df6d1ae54d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:01.554010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:01.608202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc545-3c3a-45d7-979f-04df6d1ae54d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:01.610969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc545-3c3a-45d7-979f-04df6d1ae54d service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:01.619175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 696/1399] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:49:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:49:01.623209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b0ba-a27d-4426-84f6-93ebc6e4993e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:01.623840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b0ba-a27d-4426-84f6-93ebc6e4993e service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:01.624222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b0ba-a27d-4426-84f6-93ebc6e4993e service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:01.625540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b0ba-a27d-4426-84f6-93ebc6e4993e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:01.626993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ea34b0ba-a27d-4426-84f6-93ebc6e4993e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:01.730623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b0ba-a27d-4426-84f6-93ebc6e4993e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:01.732550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b0ba-a27d-4426-84f6-93ebc6e4993e service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:01.759019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 704/1400] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:49:04.150613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc13c-477c-475b-af63-87e87da2a7c3 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:04.151205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc13c-477c-475b-af63-87e87da2a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:04.151205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc13c-477c-475b-af63-87e87da2a7c3 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:04.152478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 697/1401] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:04.157975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8374b-528c-4fdf-bb1b-4b7140d6531f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:04.158866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8374b-528c-4fdf-bb1b-4b7140d6531f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:04.159144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8374b-528c-4fdf-bb1b-4b7140d6531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:04.236682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-cdf8374b-528c-4fdf-bb1b-4b7140d6531f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:04.238051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cdf8374b-528c-4fdf-bb1b-4b7140d6531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:04.241550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:04.353924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 705/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:04.654156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efc13c-477c-475b-af63-87e87da2a7c3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:04.656311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d1efc13c-477c-475b-af63-87e87da2a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:04.744091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:04.821050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efc13c-477c-475b-af63-87e87da2a7c3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:04.954729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95257d9-df56-4810-9d96-322d828e5c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:04.955379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95257d9-df56-4810-9d96-322d828e5c8a service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:04.955663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95257d9-df56-4810-9d96-322d828e5c8a service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:04.955938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95257d9-df56-4810-9d96-322d828e5c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:04.957684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a95257d9-df56-4810-9d96-322d828e5c8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:05.007483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:05.065082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95257d9-df56-4810-9d96-322d828e5c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:05.067103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95257d9-df56-4810-9d96-322d828e5c8a service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:05.088432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 698/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:07.401802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfea4-85d1-42ec-9d11-057e825cc00b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:07.402387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfea4-85d1-42ec-9d11-057e825cc00b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:07.402387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfea4-85d1-42ec-9d11-057e825cc00b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:07.403863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 706/1404] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:07.409817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499ff44-8330-4a72-bf08-5a98184f012a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:07.410294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499ff44-8330-4a72-bf08-5a98184f012a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:07.410391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499ff44-8330-4a72-bf08-5a98184f012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:07.490954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a499ff44-8330-4a72-bf08-5a98184f012a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:07.492307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a499ff44-8330-4a72-bf08-5a98184f012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:07.603418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 699/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:07.900789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dfea4-85d1-42ec-9d11-057e825cc00b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:07.902680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6b2dfea4-85d1-42ec-9d11-057e825cc00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:08.063941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:08.079630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dfea4-85d1-42ec-9d11-057e825cc00b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:08.209967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58217525-9337-4ee7-a0c9-135cd54f2b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:08.210577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58217525-9337-4ee7-a0c9-135cd54f2b4e service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:08.210851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58217525-9337-4ee7-a0c9-135cd54f2b4e service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:08.211117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58217525-9337-4ee7-a0c9-135cd54f2b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:08.212709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-58217525-9337-4ee7-a0c9-135cd54f2b4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:08.314931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58217525-9337-4ee7-a0c9-135cd54f2b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:08.316562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58217525-9337-4ee7-a0c9-135cd54f2b4e service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:08.326183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:08.336821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 707/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:10.642457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d913c0-e8ef-4bb1-83e6-f6e1730c56f4 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:10.643024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d913c0-e8ef-4bb1-83e6-f6e1730c56f4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:10.643024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d913c0-e8ef-4bb1-83e6-f6e1730c56f4 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:10.644341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 700/1407] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:10.650428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8959-e240-4eca-8038-0775b2d769f7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:10.650428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8959-e240-4eca-8038-0775b2d769f7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:10.650428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8959-e240-4eca-8038-0775b2d769f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:10.725339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-12af8959-e240-4eca-8038-0775b2d769f7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:10.726835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-12af8959-e240-4eca-8038-0775b2d769f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:10.832102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 708/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:11.125564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d913c0-e8ef-4bb1-83e6-f6e1730c56f4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:11.127083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-35d913c0-e8ef-4bb1-83e6-f6e1730c56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:11.150678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:11.287377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d913c0-e8ef-4bb1-83e6-f6e1730c56f4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:11.391444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:11.415575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bec69f-a4e2-40f3-bcb6-8d9c60a93b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:11.416161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec69f-a4e2-40f3-bcb6-8d9c60a93b6a service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:11.416439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec69f-a4e2-40f3-bcb6-8d9c60a93b6a service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:11.416705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec69f-a4e2-40f3-bcb6-8d9c60a93b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:11.418343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-37bec69f-a4e2-40f3-bcb6-8d9c60a93b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:11.519703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bec69f-a4e2-40f3-bcb6-8d9c60a93b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:11.521365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bec69f-a4e2-40f3-bcb6-8d9c60a93b6a service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:11.541830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 701/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:20.830038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=68 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:21.537082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=54 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:24.994531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a04fd8-5749-49ea-b6b3-64d3f22a21ed None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:24.995059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a04fd8-5749-49ea-b6b3-64d3f22a21ed None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:24.995059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a04fd8-5749-49ea-b6b3-64d3f22a21ed None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:24.996372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 709/1410] 10.222.0.42 () {54 vars in 918 bytes} [Mon Sep 19 11:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:25.002162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b93-e188-488f-9afb-0a7a421ebfed None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:25.002554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b93-e188-488f-9afb-0a7a421ebfed None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:25.002699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b93-e188-488f-9afb-0a7a421ebfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:25.077285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5ef53b93-e188-488f-9afb-0a7a421ebfed None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:25.078499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5ef53b93-e188-488f-9afb-0a7a421ebfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:25.186124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 702/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Sep 19 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:25.200219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cba040-22b3-4b82-b8e4-74868012db12 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:25.200503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cba040-22b3-4b82-b8e4-74868012db12 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:25.200777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cba040-22b3-4b82-b8e4-74868012db12 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:25.202213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 710/1412] 10.222.0.42 () {54 vars in 918 bytes} [Mon Sep 19 11:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:25.206816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24d86-a7e3-4cb4-8194-0cd098939b90 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:25.207096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24d86-a7e3-4cb4-8194-0cd098939b90 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:25.207366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d24d86-a7e3-4cb4-8194-0cd098939b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:25.280609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:25.283794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-45d24d86-a7e3-4cb4-8194-0cd098939b90 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:25.285571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-45d24d86-a7e3-4cb4-8194-0cd098939b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:25.402132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 703/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Sep 19 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:27.999362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb9a6-f60f-4323-91b4-c56975951dfd None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:27.999916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb9a6-f60f-4323-91b4-c56975951dfd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:27.999916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb9a6-f60f-4323-91b4-c56975951dfd None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:28.001167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:28.006426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472ef3-9e6f-4c28-842e-61731922b204 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:28.006828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472ef3-9e6f-4c28-842e-61731922b204 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:28.006970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472ef3-9e6f-4c28-842e-61731922b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:28.072659 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4f472ef3-9e6f-4c28-842e-61731922b204 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:28.073898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4f472ef3-9e6f-4c28-842e-61731922b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:28.128756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:28.171815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:28.464579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fb9a6-f60f-4323-91b4-c56975951dfd None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:28.466216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1d2fb9a6-f60f-4323-91b4-c56975951dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:28.612325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fb9a6-f60f-4323-91b4-c56975951dfd None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:28.686303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:28.726336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb3b10-06b7-481d-a609-f683222901f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:28.726967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3b10-06b7-481d-a609-f683222901f3 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:28.727245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3b10-06b7-481d-a609-f683222901f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:28.727517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3b10-06b7-481d-a609-f683222901f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:28.729115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8afb3b10-06b7-481d-a609-f683222901f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:28.820466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb3b10-06b7-481d-a609-f683222901f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:28.822087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb3b10-06b7-481d-a609-f683222901f3 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:28.839848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 712/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:29.984946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288ea6a-7d0a-41b7-a3c7-51f597b6a1b6 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:29.985507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288ea6a-7d0a-41b7-a3c7-51f597b6a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:29.985507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288ea6a-7d0a-41b7-a3c7-51f597b6a1b6 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:29.986783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:29.992910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4694-da95-417b-a19b-66706d8d9e69 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:29.993365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4694-da95-417b-a19b-66706d8d9e69 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:29.993485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4694-da95-417b-a19b-66706d8d9e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:30.069267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ea2d4694-da95-417b-a19b-66706d8d9e69 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:30.070466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ea2d4694-da95-417b-a19b-66706d8d9e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:30.097301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:30.168142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:30.319258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288ea6a-7d0a-41b7-a3c7-51f597b6a1b6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:30.320786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4288ea6a-7d0a-41b7-a3c7-51f597b6a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:30.464665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288ea6a-7d0a-41b7-a3c7-51f597b6a1b6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:30.506501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:30.581258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb0548-1a9a-422b-8c9a-23257ad32ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:30.581849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb0548-1a9a-422b-8c9a-23257ad32ac2 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:30.582121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb0548-1a9a-422b-8c9a-23257ad32ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:30.582387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb0548-1a9a-422b-8c9a-23257ad32ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:30.583950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-93fb0548-1a9a-422b-8c9a-23257ad32ac2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:30.674925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb0548-1a9a-422b-8c9a-23257ad32ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:30.676556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb0548-1a9a-422b-8c9a-23257ad32ac2 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:30.694076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 706/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:31.827480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47a07-c242-4e41-ae3e-49d033539761 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:31.828038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47a07-c242-4e41-ae3e-49d033539761 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:31.828038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47a07-c242-4e41-ae3e-49d033539761 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:31.829462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:31.835737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae966-929c-44b2-a495-0c828fc1b446 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:31.836172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae966-929c-44b2-a495-0c828fc1b446 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:31.836267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae966-929c-44b2-a495-0c828fc1b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:31.890982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:31.912954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-93eae966-929c-44b2-a495-0c828fc1b446 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:31.914141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-93eae966-929c-44b2-a495-0c828fc1b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:32.008163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:32.159073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe47a07-c242-4e41-ae3e-49d033539761 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:32.160577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7fe47a07-c242-4e41-ae3e-49d033539761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:32.306267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe47a07-c242-4e41-ae3e-49d033539761 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:32.318375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:32.420420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705649ad-fae8-439a-a548-ea811a80c8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:32.421008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705649ad-fae8-439a-a548-ea811a80c8ec service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:32.421309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705649ad-fae8-439a-a548-ea811a80c8ec service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:32.421578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705649ad-fae8-439a-a548-ea811a80c8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:32.423166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-705649ad-fae8-439a-a548-ea811a80c8ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:32.512633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705649ad-fae8-439a-a548-ea811a80c8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:32.514764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705649ad-fae8-439a-a548-ea811a80c8ec service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:32.532716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 715/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:33.640295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee67c-4f96-42b6-9f20-4b213938f7ae None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:33.640900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee67c-4f96-42b6-9f20-4b213938f7ae None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:33.640900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee67c-4f96-42b6-9f20-4b213938f7ae None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:33.642238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:33.648790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a9ce-02bc-40a7-8750-af035d90783c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:33.649318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a9ce-02bc-40a7-8750-af035d90783c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:33.649413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a9ce-02bc-40a7-8750-af035d90783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:33.670904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:33.728629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4168a9ce-02bc-40a7-8750-af035d90783c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:33.729848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4168a9ce-02bc-40a7-8750-af035d90783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:33.828625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:49:33.979293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee67c-4f96-42b6-9f20-4b213938f7ae None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:33.980720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-350ee67c-4f96-42b6-9f20-4b213938f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:34.090300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:34.127427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee67c-4f96-42b6-9f20-4b213938f7ae None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:34.239692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28402a8a-ca1b-47fa-bc30-870bc7aaa222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:34.240217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402a8a-ca1b-47fa-bc30-870bc7aaa222 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:34.240494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402a8a-ca1b-47fa-bc30-870bc7aaa222 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:34.240764 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402a8a-ca1b-47fa-bc30-870bc7aaa222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:34.242384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-28402a8a-ca1b-47fa-bc30-870bc7aaa222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:34.319150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:34.333291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402a8a-ca1b-47fa-bc30-870bc7aaa222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:34.334891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402a8a-ca1b-47fa-bc30-870bc7aaa222 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:34.353202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 709/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:35.473307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de18d6-b10c-408e-85e0-fb07309c3042 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:35.473921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de18d6-b10c-408e-85e0-fb07309c3042 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:35.473921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de18d6-b10c-408e-85e0-fb07309c3042 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:35.475135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:35.482160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6775260-fa3a-4a2f-bef6-3c32f452178b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:35.483043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6775260-fa3a-4a2f-bef6-3c32f452178b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:35.483043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6775260-fa3a-4a2f-bef6-3c32f452178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:35.557332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d6775260-fa3a-4a2f-bef6-3c32f452178b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:35.558535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d6775260-fa3a-4a2f-bef6-3c32f452178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:35.654541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:35.805838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de18d6-b10c-408e-85e0-fb07309c3042 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:35.807341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a9de18d6-b10c-408e-85e0-fb07309c3042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:35.891422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:35.953334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de18d6-b10c-408e-85e0-fb07309c3042 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:36.065983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df829f-933f-4111-a2a4-0a7e553c033b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:36.066501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df829f-933f-4111-a2a4-0a7e553c033b service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:36.066780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df829f-933f-4111-a2a4-0a7e553c033b service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:36.067050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df829f-933f-4111-a2a4-0a7e553c033b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:36.068654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-29df829f-933f-4111-a2a4-0a7e553c033b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:36.117069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:36.158888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df829f-933f-4111-a2a4-0a7e553c033b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:36.160551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df829f-933f-4111-a2a4-0a7e553c033b service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:36.179290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 718/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:49:37.263971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fc47-9ae1-4c5c-8daa-0427c59e8a8b None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:37.264539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fc47-9ae1-4c5c-8daa-0427c59e8a8b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:37.264539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fc47-9ae1-4c5c-8daa-0427c59e8a8b None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:37.265867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:37.272190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2618b-0e41-4928-9429-e2f33cb816bb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:37.272627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2618b-0e41-4928-9429-e2f33cb816bb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:37.272794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2618b-0e41-4928-9429-e2f33cb816bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:37.348792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-96f2618b-0e41-4928-9429-e2f33cb816bb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:37.351780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-96f2618b-0e41-4928-9429-e2f33cb816bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:37.449517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:37.605461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fc47-9ae1-4c5c-8daa-0427c59e8a8b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:37.607204 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3f50fc47-9ae1-4c5c-8daa-0427c59e8a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:37.656201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:37.753019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fc47-9ae1-4c5c-8daa-0427c59e8a8b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:37.865228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbd32d-e277-48f2-bff3-22c441fca619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:37.865756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbd32d-e277-48f2-bff3-22c441fca619 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:37.866031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbd32d-e277-48f2-bff3-22c441fca619 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:37.866302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbd32d-e277-48f2-bff3-22c441fca619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:37.867882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-becbd32d-e277-48f2-bff3-22c441fca619 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:37.875472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:37.959243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbd32d-e277-48f2-bff3-22c441fca619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:37.960832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbd32d-e277-48f2-bff3-22c441fca619 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:37.978508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 712/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:39.044383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7324d-c3f5-4ebd-82bc-940b02bf636c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:39.045175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7324d-c3f5-4ebd-82bc-940b02bf636c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:39.045175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7324d-c3f5-4ebd-82bc-940b02bf636c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:39.046242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:39.052518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaf2a5-b311-434c-982c-a1494c41427b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:39.052985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaf2a5-b311-434c-982c-a1494c41427b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:39.053105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaf2a5-b311-434c-982c-a1494c41427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:39.128955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4dbaf2a5-b311-434c-982c-a1494c41427b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:39.130178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4dbaf2a5-b311-434c-982c-a1494c41427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:39.200830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:39.229308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:39.382634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7324d-c3f5-4ebd-82bc-940b02bf636c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:39.384132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-40e7324d-c3f5-4ebd-82bc-940b02bf636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:39.401860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:39.530463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7324d-c3f5-4ebd-82bc-940b02bf636c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:39.618279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:39.644644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83027d41-f661-4fe2-b939-e41fc49dc049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:39.645201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83027d41-f661-4fe2-b939-e41fc49dc049 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:39.645482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83027d41-f661-4fe2-b939-e41fc49dc049 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:39.645750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83027d41-f661-4fe2-b939-e41fc49dc049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:39.647353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-83027d41-f661-4fe2-b939-e41fc49dc049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:39.737550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83027d41-f661-4fe2-b939-e41fc49dc049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:39.739152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83027d41-f661-4fe2-b939-e41fc49dc049 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:39.756744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 721/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:40.819823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff15e0-7e0c-4dd0-b35b-76ea0c3e544f None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:40.820383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff15e0-7e0c-4dd0-b35b-76ea0c3e544f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:40.820383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff15e0-7e0c-4dd0-b35b-76ea0c3e544f None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:40.821736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:40.828409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086073-4dd9-419d-bde7-fca4a601cf1b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:40.828874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086073-4dd9-419d-bde7-fca4a601cf1b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:40.828989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086073-4dd9-419d-bde7-fca4a601cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:40.905578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e5086073-4dd9-419d-bde7-fca4a601cf1b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:40.906832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e5086073-4dd9-419d-bde7-fca4a601cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:40.947754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:41.003160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:41.152608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff15e0-7e0c-4dd0-b35b-76ea0c3e544f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:41.154974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-83ff15e0-7e0c-4dd0-b35b-76ea0c3e544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:41.299827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff15e0-7e0c-4dd0-b35b-76ea0c3e544f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:41.353995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:41.414901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0b0ff-4cb3-419c-85e3-5a64effbf65b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:41.415502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b0ff-4cb3-419c-85e3-5a64effbf65b service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:41.415778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b0ff-4cb3-419c-85e3-5a64effbf65b service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:41.416046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b0ff-4cb3-419c-85e3-5a64effbf65b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:41.417675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1ef0b0ff-4cb3-419c-85e3-5a64effbf65b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:41.506863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0b0ff-4cb3-419c-85e3-5a64effbf65b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:41.508450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0b0ff-4cb3-419c-85e3-5a64effbf65b service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:41.526154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 715/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:42.580963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6417-8aa8-47d3-a231-1fdda845dc36 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:42.581516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6417-8aa8-47d3-a231-1fdda845dc36 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:42.581645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6417-8aa8-47d3-a231-1fdda845dc36 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:42.582892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:42.589120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ba78-0f48-4348-93c7-2a68ee9c7c76 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:42.589590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ba78-0f48-4348-93c7-2a68ee9c7c76 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:42.589699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ba78-0f48-4348-93c7-2a68ee9c7c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:42.666216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fe36ba78-0f48-4348-93c7-2a68ee9c7c76 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:42.667430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fe36ba78-0f48-4348-93c7-2a68ee9c7c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:42.669717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:42.765332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:42.915179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6417-8aa8-47d3-a231-1fdda845dc36 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:42.916660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ea1a6417-8aa8-47d3-a231-1fdda845dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:43.076520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6417-8aa8-47d3-a231-1fdda845dc36 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:43.104427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:43.191049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8701-7f19-4209-bf68-7020cd17391c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:43.191579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8701-7f19-4209-bf68-7020cd17391c service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:43.191857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8701-7f19-4209-bf68-7020cd17391c service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:43.192126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8701-7f19-4209-bf68-7020cd17391c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:43.193744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-dc9d8701-7f19-4209-bf68-7020cd17391c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:43.282645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8701-7f19-4209-bf68-7020cd17391c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:43.284244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8701-7f19-4209-bf68-7020cd17391c service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:43.302753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 724/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:45.408002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d849-1a38-43ff-828b-afa0ac33d043 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:45.408570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d849-1a38-43ff-828b-afa0ac33d043 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:45.408570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d849-1a38-43ff-828b-afa0ac33d043 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:45.409932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:45.415658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6cee-afff-49f1-a3e5-16b2e1d4b998 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:45.416092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6cee-afff-49f1-a3e5-16b2e1d4b998 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:45.416202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6cee-afff-49f1-a3e5-16b2e1d4b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:45.456627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:45.483998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7d9b6cee-afff-49f1-a3e5-16b2e1d4b998 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:45.485240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7d9b6cee-afff-49f1-a3e5-16b2e1d4b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:45.580342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:45.864037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d849-1a38-43ff-828b-afa0ac33d043 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:45.865608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2604d849-1a38-43ff-828b-afa0ac33d043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:45.968613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d849-1a38-43ff-828b-afa0ac33d043 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:46.000260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:46.043385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9bcef-a61c-4c2f-814e-527f24e290da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:46.043987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bcef-a61c-4c2f-814e-527f24e290da service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:46.044258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bcef-a61c-4c2f-814e-527f24e290da service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:46.044530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bcef-a61c-4c2f-814e-527f24e290da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:46.046141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-64e9bcef-a61c-4c2f-814e-527f24e290da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:46.153376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9bcef-a61c-4c2f-814e-527f24e290da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:46.154500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9bcef-a61c-4c2f-814e-527f24e290da service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:46.173399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 718/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:48.492849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b8606-732d-4b99-8d9c-9f5f3e71dfc8 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:48.493414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b8606-732d-4b99-8d9c-9f5f3e71dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:48.493414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b8606-732d-4b99-8d9c-9f5f3e71dfc8 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:48.494784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:48.500042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c99e6-f351-4621-b394-f310c40170a9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:48.500497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c99e6-f351-4621-b394-f310c40170a9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:48.500603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c99e6-f351-4621-b394-f310c40170a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:48.566203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-047c99e6-f351-4621-b394-f310c40170a9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:48.567414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-047c99e6-f351-4621-b394-f310c40170a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:48.580433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:48.665103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:48.953448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b8606-732d-4b99-8d9c-9f5f3e71dfc8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:48.954987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-665b8606-732d-4b99-8d9c-9f5f3e71dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:49.057901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b8606-732d-4b99-8d9c-9f5f3e71dfc8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:49.071174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:49.131987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba49d-7aab-486f-a409-98f4cb8ecfaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:49.132578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba49d-7aab-486f-a409-98f4cb8ecfaa service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:49.132856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba49d-7aab-486f-a409-98f4cb8ecfaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:49.133126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba49d-7aab-486f-a409-98f4cb8ecfaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:49.134739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a8fba49d-7aab-486f-a409-98f4cb8ecfaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:49.242642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fba49d-7aab-486f-a409-98f4cb8ecfaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:49.243984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fba49d-7aab-486f-a409-98f4cb8ecfaa service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:49.261462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 727/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:51.745670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b85d-5bac-4125-81e8-60bc388174bd None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:51.746224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b85d-5bac-4125-81e8-60bc388174bd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:51.746324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b85d-5bac-4125-81e8-60bc388174bd None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:51.747737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:51.752990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32a2a1-c4b7-4dbd-9df0-3119eb624834 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:51.753444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32a2a1-c4b7-4dbd-9df0-3119eb624834 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:51.753577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32a2a1-c4b7-4dbd-9df0-3119eb624834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:51.802017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:51.819775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3b32a2a1-c4b7-4dbd-9df0-3119eb624834 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:51.820988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3b32a2a1-c4b7-4dbd-9df0-3119eb624834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:51.917583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:52.204212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335b85d-5bac-4125-81e8-60bc388174bd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:52.205773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8335b85d-5bac-4125-81e8-60bc388174bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:52.306900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335b85d-5bac-4125-81e8-60bc388174bd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:52.347025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:52.381480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aec18-62fb-4da3-ac79-027158aedf0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:52.382078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aec18-62fb-4da3-ac79-027158aedf0f service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:52.382353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aec18-62fb-4da3-ac79-027158aedf0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:52.382621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aec18-62fb-4da3-ac79-027158aedf0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:52.384191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c16aec18-62fb-4da3-ac79-027158aedf0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:52.491665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aec18-62fb-4da3-ac79-027158aedf0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:52.493012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aec18-62fb-4da3-ac79-027158aedf0f service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:52.511118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 721/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:54.858634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4cc0-d3ae-4da8-91ed-918f48501921 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:54.859219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4cc0-d3ae-4da8-91ed-918f48501921 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:54.859219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4cc0-d3ae-4da8-91ed-918f48501921 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:54.860504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:49:54.865907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73accca8-a726-414d-bd69-1cc8fe2540cc None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:54.866329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73accca8-a726-414d-bd69-1cc8fe2540cc None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:54.866521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73accca8-a726-414d-bd69-1cc8fe2540cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:54.933005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-73accca8-a726-414d-bd69-1cc8fe2540cc None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:54.934791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-73accca8-a726-414d-bd69-1cc8fe2540cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:54.955216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:55.030744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:55.316026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d4cc0-d3ae-4da8-91ed-918f48501921 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:55.317615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2c8d4cc0-d3ae-4da8-91ed-918f48501921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:55.421745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d4cc0-d3ae-4da8-91ed-918f48501921 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:55.442190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:55.497781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d547a1-ffe8-4f5c-810e-68ea82b5d5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:55.498381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d547a1-ffe8-4f5c-810e-68ea82b5d5ef service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:55.498661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d547a1-ffe8-4f5c-810e-68ea82b5d5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:55.498954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d547a1-ffe8-4f5c-810e-68ea82b5d5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:55.500542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a2d547a1-ffe8-4f5c-810e-68ea82b5d5ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:55.609598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d547a1-ffe8-4f5c-810e-68ea82b5d5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:55.610948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d547a1-ffe8-4f5c-810e-68ea82b5d5ef service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:55.628594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 730/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:57.843471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18575d-8ba6-4257-ba5e-96fc2e2bc691 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:57.844030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18575d-8ba6-4257-ba5e-96fc2e2bc691 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:57.844030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18575d-8ba6-4257-ba5e-96fc2e2bc691 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:57.845452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:49:57.850828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480694d-8e52-40dc-8ee3-9e138c5b46f7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:57.851252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480694d-8e52-40dc-8ee3-9e138c5b46f7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:57.851373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480694d-8e52-40dc-8ee3-9e138c5b46f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:57.924443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:57.927214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e480694d-8e52-40dc-8ee3-9e138c5b46f7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:49:57.929078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e480694d-8e52-40dc-8ee3-9e138c5b46f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:58.026160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:49:58.313657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18575d-8ba6-4257-ba5e-96fc2e2bc691 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:49:58.315221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bc18575d-8ba6-4257-ba5e-96fc2e2bc691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:58.419520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18575d-8ba6-4257-ba5e-96fc2e2bc691 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:49:58.468610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:49:58.493437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822a36-0421-49a7-9b56-094d9edc07a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:49:58.494027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822a36-0421-49a7-9b56-094d9edc07a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:49:58.494302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822a36-0421-49a7-9b56-094d9edc07a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:49:58.494570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822a36-0421-49a7-9b56-094d9edc07a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:49:58.500873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-05822a36-0421-49a7-9b56-094d9edc07a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:49:58.615638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05822a36-0421-49a7-9b56-094d9edc07a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:49:58.616986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05822a36-0421-49a7-9b56-094d9edc07a2 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:49:58.635138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 724/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:00.858120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116669-fedf-4ee0-872a-84bc87cb24c2 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:00.858654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116669-fedf-4ee0-872a-84bc87cb24c2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:00.858654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116669-fedf-4ee0-872a-84bc87cb24c2 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:00.860006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:00.865368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6254-0e2a-40fa-8252-cedfc645e479 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:00.865761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6254-0e2a-40fa-8252-cedfc645e479 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:00.865912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6254-0e2a-40fa-8252-cedfc645e479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:00.931676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f8ea6254-0e2a-40fa-8252-cedfc645e479 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:00.932817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f8ea6254-0e2a-40fa-8252-cedfc645e479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:00.969758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:01.040591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:01.340877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32116669-fedf-4ee0-872a-84bc87cb24c2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:01.342430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-32116669-fedf-4ee0-872a-84bc87cb24c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:01.447383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32116669-fedf-4ee0-872a-84bc87cb24c2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:01.479858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:01.529552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87881-9b86-4b6e-90fd-3adafd787f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:01.530145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87881-9b86-4b6e-90fd-3adafd787f2f service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:01.530424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87881-9b86-4b6e-90fd-3adafd787f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:01.530698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87881-9b86-4b6e-90fd-3adafd787f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:01.532303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-09f87881-9b86-4b6e-90fd-3adafd787f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:01.649660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f87881-9b86-4b6e-90fd-3adafd787f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:01.651015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f87881-9b86-4b6e-90fd-3adafd787f2f service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:01.789518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 733/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:04.044543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83981c8-ea84-431b-9e04-beb60f450163 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:04.045080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83981c8-ea84-431b-9e04-beb60f450163 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:04.045080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83981c8-ea84-431b-9e04-beb60f450163 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:04.046422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:04.051714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e17f1-3320-4577-afb7-88adc76cb258 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:04.052164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e17f1-3320-4577-afb7-88adc76cb258 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:04.052275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e17f1-3320-4577-afb7-88adc76cb258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:04.119559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-237e17f1-3320-4577-afb7-88adc76cb258 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:04.121091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-237e17f1-3320-4577-afb7-88adc76cb258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:04.129381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:04.217412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:04.509131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83981c8-ea84-431b-9e04-beb60f450163 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:04.510720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e83981c8-ea84-431b-9e04-beb60f450163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:04.614462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83981c8-ea84-431b-9e04-beb60f450163 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:04.673030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:04.691982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20a441-c861-474a-81c8-405f42359ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:04.692586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a441-c861-474a-81c8-405f42359ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:04.692864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a441-c861-474a-81c8-405f42359ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:04.693131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a441-c861-474a-81c8-405f42359ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:04.694756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cb20a441-c861-474a-81c8-405f42359ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:04.806249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20a441-c861-474a-81c8-405f42359ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:04.807670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20a441-c861-474a-81c8-405f42359ba2 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:04.827979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 727/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:07.028904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e4c6-4910-4e6c-93ba-ba6ebcc66fbd None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:07.029541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e4c6-4910-4e6c-93ba-ba6ebcc66fbd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:07.029541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e4c6-4910-4e6c-93ba-ba6ebcc66fbd None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:07.030814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:07.036091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8cdb-b642-48af-bae8-dbfe81555500 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:07.036529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8cdb-b642-48af-bae8-dbfe81555500 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:07.036649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8cdb-b642-48af-bae8-dbfe81555500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:07.101591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-553e8cdb-b642-48af-bae8-dbfe81555500 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:07.102798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-553e8cdb-b642-48af-bae8-dbfe81555500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:07.141712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:07.199639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:07.482723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e4c6-4910-4e6c-93ba-ba6ebcc66fbd None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:07.484277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4606e4c6-4910-4e6c-93ba-ba6ebcc66fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:07.587075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e4c6-4910-4e6c-93ba-ba6ebcc66fbd None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:07.625904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:07.661272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7258614-cb6b-4d33-b504-239ca2b2122c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:07.661877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258614-cb6b-4d33-b504-239ca2b2122c service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:07.662155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258614-cb6b-4d33-b504-239ca2b2122c service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:07.662424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258614-cb6b-4d33-b504-239ca2b2122c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:07.664007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f7258614-cb6b-4d33-b504-239ca2b2122c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:07.778033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7258614-cb6b-4d33-b504-239ca2b2122c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:07.779443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7258614-cb6b-4d33-b504-239ca2b2122c service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:07.797358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 736/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:10.065235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419ed8e-b80e-49bb-9de0-9e38fdf1e5df None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:10.065797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419ed8e-b80e-49bb-9de0-9e38fdf1e5df None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:10.065797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419ed8e-b80e-49bb-9de0-9e38fdf1e5df None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:10.067137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:10.072541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb616d-cc90-493a-bdcd-cbfc976ea35c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:10.072941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb616d-cc90-493a-bdcd-cbfc976ea35c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:10.073111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb616d-cc90-493a-bdcd-cbfc976ea35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:10.140109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-febb616d-cc90-493a-bdcd-cbfc976ea35c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:10.141326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-febb616d-cc90-493a-bdcd-cbfc976ea35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:10.159062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:10.244896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:10.534185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419ed8e-b80e-49bb-9de0-9e38fdf1e5df None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:10.535756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e419ed8e-b80e-49bb-9de0-9e38fdf1e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:10.638515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419ed8e-b80e-49bb-9de0-9e38fdf1e5df None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:10.706044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:10.712984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe405a-2d8d-4906-a739-1936a0fac017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:10.713609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe405a-2d8d-4906-a739-1936a0fac017 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:10.713926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe405a-2d8d-4906-a739-1936a0fac017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:10.714693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe405a-2d8d-4906-a739-1936a0fac017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:10.716336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b6fe405a-2d8d-4906-a739-1936a0fac017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:10.824253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe405a-2d8d-4906-a739-1936a0fac017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:10.825724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe405a-2d8d-4906-a739-1936a0fac017 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:10.843896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 730/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:13.018478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356358-427e-44d4-8edc-77721733a59e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:13.019039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356358-427e-44d4-8edc-77721733a59e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:13.019039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356358-427e-44d4-8edc-77721733a59e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:13.020300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:13.025597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32acae9-9d65-4a93-a3f9-d89780ff6552 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:13.026040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32acae9-9d65-4a93-a3f9-d89780ff6552 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:13.026149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32acae9-9d65-4a93-a3f9-d89780ff6552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:13.092211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b32acae9-9d65-4a93-a3f9-d89780ff6552 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:13.093468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b32acae9-9d65-4a93-a3f9-d89780ff6552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:13.141201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:13.189698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:13.472689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae356358-427e-44d4-8edc-77721733a59e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:13.474323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ae356358-427e-44d4-8edc-77721733a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:13.576396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae356358-427e-44d4-8edc-77721733a59e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:13.624945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:13.651872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ac7f-0eb9-4e2e-958c-cf138d92a366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:13.652471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ac7f-0eb9-4e2e-958c-cf138d92a366 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:13.652748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ac7f-0eb9-4e2e-958c-cf138d92a366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:13.653015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ac7f-0eb9-4e2e-958c-cf138d92a366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:13.654660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e754ac7f-0eb9-4e2e-958c-cf138d92a366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:13.763920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ac7f-0eb9-4e2e-958c-cf138d92a366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:13.765275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ac7f-0eb9-4e2e-958c-cf138d92a366 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:13.782825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 739/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:23.188237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=22 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:23.780605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=66 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:34.073970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17df0f-8954-4822-980e-bde24c0cd12c None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:34.074537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17df0f-8954-4822-980e-bde24c0cd12c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:34.074537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17df0f-8954-4822-980e-bde24c0cd12c None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:34.075850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 732/1471] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:34.081802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4acc13-4c27-4d5c-8e31-b7b8975a8066 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:34.082211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4acc13-4c27-4d5c-8e31-b7b8975a8066 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:34.082441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4acc13-4c27-4d5c-8e31-b7b8975a8066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:34.154298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bb4acc13-4c27-4d5c-8e31-b7b8975a8066 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:34.155505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bb4acc13-4c27-4d5c-8e31-b7b8975a8066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:34.251346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 740/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:50:34.552027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385b3f-9021-4242-8594-8d6a1fb25f05 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:34.552358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385b3f-9021-4242-8594-8d6a1fb25f05 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:34.552687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385b3f-9021-4242-8594-8d6a1fb25f05 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:34.554275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 733/1473] 10.222.0.42 () {54 vars in 962 bytes} [Mon Sep 19 11:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:34.560280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2433085-8459-42fd-bb2a-fe069781bc9d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:34.560676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2433085-8459-42fd-bb2a-fe069781bc9d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:34.561026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2433085-8459-42fd-bb2a-fe069781bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:34.662905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c2433085-8459-42fd-bb2a-fe069781bc9d None None] MFA Rules not processed for user `f951f4e6a8e5407580ec1ead59fdeec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:34.664519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c2433085-8459-42fd-bb2a-fe069781bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:34.693116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:34.767191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 741/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Sep 19 11:50:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:34.774991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5385b3f-9021-4242-8594-8d6a1fb25f05 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:34.777184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d5385b3f-9021-4242-8594-8d6a1fb25f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:34.895024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5385b3f-9021-4242-8594-8d6a1fb25f05 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:34.977841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f12a4-b6e9-4851-a2e8-e644ada42bf8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:34.979092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f12a4-b6e9-4851-a2e8-e644ada42bf8 service glance] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:34.979368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f12a4-b6e9-4851-a2e8-e644ada42bf8 service glance] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:34.979637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f12a4-b6e9-4851-a2e8-e644ada42bf8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:34.981276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4b9f12a4-b6e9-4851-a2e8-e644ada42bf8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:35.035894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:35.093749 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f12a4-b6e9-4851-a2e8-e644ada42bf8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:35.095196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f12a4-b6e9-4851-a2e8-e644ada42bf8 service glance] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:35.114266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 734/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:37.370052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dabe8e-1e0c-4bda-841b-806922ecab25 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:37.370659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dabe8e-1e0c-4bda-841b-806922ecab25 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:37.370659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dabe8e-1e0c-4bda-841b-806922ecab25 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:37.372095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 742/1476] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:37.377645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009da08-29e1-4608-8073-2fc529707b45 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:37.378077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009da08-29e1-4608-8073-2fc529707b45 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:37.378182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009da08-29e1-4608-8073-2fc529707b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:37.445016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8009da08-29e1-4608-8073-2fc529707b45 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:37.446266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8009da08-29e1-4608-8073-2fc529707b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:37.542936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 735/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:37.823380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dabe8e-1e0c-4bda-841b-806922ecab25 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:37.824947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c1dabe8e-1e0c-4bda-841b-806922ecab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:37.953303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dabe8e-1e0c-4bda-841b-806922ecab25 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:38.003235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:38.047249 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a80e6-3561-4482-b71b-bb0799eb0295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:38.047847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a80e6-3561-4482-b71b-bb0799eb0295 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:38.048121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a80e6-3561-4482-b71b-bb0799eb0295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:38.048387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a80e6-3561-4482-b71b-bb0799eb0295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:38.049012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a80e6-3561-4482-b71b-bb0799eb0295 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:38.050771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-572a80e6-3561-4482-b71b-bb0799eb0295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:50:38.050771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:50:38.050771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:50:38.051897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a80e6-3561-4482-b71b-bb0799eb0295 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:38.071209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 743/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Sep 19 11:50:37 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:50:40.237275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57734-e69d-462c-9596-d1324638238e None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:40.237842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57734-e69d-462c-9596-d1324638238e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:40.237842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57734-e69d-462c-9596-d1324638238e None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:40.239159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 736/1479] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:40.244283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88be85-fb2d-49e1-bb02-c11d091b64b2 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:40.244717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88be85-fb2d-49e1-bb02-c11d091b64b2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:40.244823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88be85-fb2d-49e1-bb02-c11d091b64b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:40.310628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-8b88be85-fb2d-49e1-bb02-c11d091b64b2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:40.311831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8b88be85-fb2d-49e1-bb02-c11d091b64b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:40.408531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 744/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:40.704471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57734-e69d-462c-9596-d1324638238e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:40.706038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dbb57734-e69d-462c-9596-d1324638238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:40.716539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:40.850960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57734-e69d-462c-9596-d1324638238e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:40.930754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:40.964146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab6543-5d0c-4e7e-aab5-7bc3f5dfe26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:40.964754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6543-5d0c-4e7e-aab5-7bc3f5dfe26a service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:40.965032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6543-5d0c-4e7e-aab5-7bc3f5dfe26a service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:40.965338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab6543-5d0c-4e7e-aab5-7bc3f5dfe26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:40.966920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-daab6543-5d0c-4e7e-aab5-7bc3f5dfe26a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:41.056668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab6543-5d0c-4e7e-aab5-7bc3f5dfe26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:41.058307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab6543-5d0c-4e7e-aab5-7bc3f5dfe26a service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:41.076320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 737/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:43.412971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51bcf-de16-4544-b332-2ce6276b19a4 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:43.413565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51bcf-de16-4544-b332-2ce6276b19a4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:43.413565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51bcf-de16-4544-b332-2ce6276b19a4 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:43.414956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 745/1482] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:43.420512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a0c4-31ba-4b96-a908-ca68eb879687 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:43.420917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a0c4-31ba-4b96-a908-ca68eb879687 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:43.421076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a0c4-31ba-4b96-a908-ca68eb879687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:43.486954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7547a0c4-31ba-4b96-a908-ca68eb879687 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:43.488159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7547a0c4-31ba-4b96-a908-ca68eb879687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:43.533804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:43.584114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 738/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:43.880013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef51bcf-de16-4544-b332-2ce6276b19a4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:43.881572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-eef51bcf-de16-4544-b332-2ce6276b19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:43.906010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:43.985987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef51bcf-de16-4544-b332-2ce6276b19a4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:44.058929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965c19f-ec14-486a-9660-26732448b679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:44.059568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965c19f-ec14-486a-9660-26732448b679 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:44.059842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965c19f-ec14-486a-9660-26732448b679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:44.060106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965c19f-ec14-486a-9660-26732448b679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:44.061741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b965c19f-ec14-486a-9660-26732448b679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:44.139359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:44.174259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965c19f-ec14-486a-9660-26732448b679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:44.175684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965c19f-ec14-486a-9660-26732448b679 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:44.193789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 746/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:46.411920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9a28-c978-4561-bce4-17d5b913d530 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:46.412435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9a28-c978-4561-bce4-17d5b913d530 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:46.412435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9a28-c978-4561-bce4-17d5b913d530 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:46.413782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 739/1485] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:46.419984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae02f-5ee0-4756-b442-45c6859bd405 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:46.420408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae02f-5ee0-4756-b442-45c6859bd405 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:46.420511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae02f-5ee0-4756-b442-45c6859bd405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:46.486070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7adae02f-5ee0-4756-b442-45c6859bd405 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:46.487268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7adae02f-5ee0-4756-b442-45c6859bd405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:46.584875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 747/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:46.891598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e9a28-c978-4561-bce4-17d5b913d530 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:46.893121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-891e9a28-c978-4561-bce4-17d5b913d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:46.997235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e9a28-c978-4561-bce4-17d5b913d530 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:47.068086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:47.069654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704c293-a4a7-4873-8db9-21d1fe955e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:47.070317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704c293-a4a7-4873-8db9-21d1fe955e5f service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:47.070629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704c293-a4a7-4873-8db9-21d1fe955e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:47.070980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704c293-a4a7-4873-8db9-21d1fe955e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:47.073447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2704c293-a4a7-4873-8db9-21d1fe955e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:47.183647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704c293-a4a7-4873-8db9-21d1fe955e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:47.185007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704c293-a4a7-4873-8db9-21d1fe955e5f service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:47.319086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 740/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:49.567956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeba6d-eef4-463c-a549-4ebd0e17c41f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:49.568546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeba6d-eef4-463c-a549-4ebd0e17c41f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:49.568546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeba6d-eef4-463c-a549-4ebd0e17c41f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:49.569925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 748/1488] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:49.575720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99766c-d55c-46ea-9657-f4cbd0e24f29 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:49.576124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99766c-d55c-46ea-9657-f4cbd0e24f29 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:49.576271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99766c-d55c-46ea-9657-f4cbd0e24f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:49.640953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-af99766c-d55c-46ea-9657-f4cbd0e24f29 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:49.642181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-af99766c-d55c-46ea-9657-f4cbd0e24f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:49.695127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:49.738623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 741/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:50.042453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeba6d-eef4-463c-a549-4ebd0e17c41f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:50.043968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7fbeba6d-eef4-463c-a549-4ebd0e17c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:50.080212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:50.147261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeba6d-eef4-463c-a549-4ebd0e17c41f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:50.221542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb6668-28fe-4945-be38-c1fb763a5fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:50.222144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb6668-28fe-4945-be38-c1fb763a5fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:50.222422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb6668-28fe-4945-be38-c1fb763a5fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:50.222692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb6668-28fe-4945-be38-c1fb763a5fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:50.224285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-edbb6668-28fe-4945-be38-c1fb763a5fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:50.304853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:50.333609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb6668-28fe-4945-be38-c1fb763a5fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:50.335027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb6668-28fe-4945-be38-c1fb763a5fcb service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:50.354093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 749/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:50:52.740377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caf7d6-a606-4c0f-9d70-be7fe8c78787 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:52.740983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caf7d6-a606-4c0f-9d70-be7fe8c78787 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:52.740983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caf7d6-a606-4c0f-9d70-be7fe8c78787 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:52.742285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 742/1491] 10.222.0.42 () {54 vars in 927 bytes} [Mon Sep 19 11:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:50:52.748218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f06c-0cc8-4ad0-aa14-d98e7063d920 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:52.748644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f06c-0cc8-4ad0-aa14-d98e7063d920 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:52.748762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f06c-0cc8-4ad0-aa14-d98e7063d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:52.814168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0e93f06c-0cc8-4ad0-aa14-d98e7063d920 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:50:52.815375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0e93f06c-0cc8-4ad0-aa14-d98e7063d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:52.911319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 750/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Mon Sep 19 11:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:50:53.208175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caf7d6-a606-4c0f-9d70-be7fe8c78787 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:50:53.209768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-99caf7d6-a606-4c0f-9d70-be7fe8c78787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:53.313823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caf7d6-a606-4c0f-9d70-be7fe8c78787 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:50:53.392620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a39e-178b-49bf-afce-1e4a7b6f2c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:50:53.393246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a39e-178b-49bf-afce-1e4a7b6f2c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:50:53.393521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a39e-178b-49bf-afce-1e4a7b6f2c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:50:53.393786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a39e-178b-49bf-afce-1e4a7b6f2c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:50:53.395353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5915a39e-178b-49bf-afce-1e4a7b6f2c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:50:53.405472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:53.504006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915a39e-178b-49bf-afce-1e4a7b6f2c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:50:53.505376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915a39e-178b-49bf-afce-1e4a7b6f2c8d service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:50:53.523425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 743/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:51:02.909813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=82 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:03.521213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=50 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:06.563233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:06.563715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:06.563820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:06.645499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:52:06.646697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:06.744354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 751/1494] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:52:06.752289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900705-2264-4901-9aba-f72e71e12386 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:06.752778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900705-2264-4901-9aba-f72e71e12386 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:06.752896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900705-2264-4901-9aba-f72e71e12386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:06.827908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1d900705-2264-4901-9aba-f72e71e12386 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:52:06.829098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1d900705-2264-4901-9aba-f72e71e12386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:06.922942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 744/1495] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:52:06.927576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:06.929653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:06.940756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df7b83-8985-45cc-b8f6-019291256855 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:07.001570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:07.036173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:07.036752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:07.037026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:07.037318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:07.038753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:52:07.039024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:07.040011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:07.040011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:52:07.040011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:52:07.040883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:07.051737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 752/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:52:07.060119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900705-2264-4901-9aba-f72e71e12386 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:07.069398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900705-2264-4901-9aba-f72e71e12386 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:07.130506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:07.164423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:07.165018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:07.165328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:07.165597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:07.166237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:07.167938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:07.167938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Sep 19 11:52:07.167938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: Sep 19 11:52:07.169119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:07.224151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 745/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:52:07 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:52:07.229102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:07.230669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:07.264370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43b90b-e703-4536-9cdb-23558c2df41f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:07.359507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:07.360102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:07.360375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:07.360643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:07.361303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:07.362296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:07.362296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:52:07.362296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:52:07.363497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:07.406463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 753/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:52:07 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:52:07.410638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:07.412133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:07.474423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11200eac-c881-47d2-9300-c64189f29493 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:07.557793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:07.568614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:07.570241 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:07.570512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:07.570775 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:07.571409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:07.572405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:07.572405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Sep 19 11:52:07.572405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: Sep 19 11:52:07.573307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:07.586424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 746/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:52:07.590479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:07.592091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:07.603797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cf9fc-6116-4931-8303-8eeb9453d510 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:07.629353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:07.700011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd07bd-4b79-479f-8c38-c89e8ebbd9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:07.700537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd07bd-4b79-479f-8c38-c89e8ebbd9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:07.700811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd07bd-4b79-479f-8c38-c89e8ebbd9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:07.701081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd07bd-4b79-479f-8c38-c89e8ebbd9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:07.701745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd07bd-4b79-479f-8c38-c89e8ebbd9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:07.702751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-8bbd07bd-4b79-479f-8c38-c89e8ebbd9b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:07.702751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:52:07.702751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:52:07.703629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd07bd-4b79-479f-8c38-c89e8ebbd9b6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:07.716241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 754/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:52:07.720488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:07.722071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:07.755471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a2d2-1af7-463b-87b2-f916516fa807 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:07.847907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d315a4-86a5-4305-ad0c-de01f36998ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:07.848560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d315a4-86a5-4305-ad0c-de01f36998ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:07.848838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d315a4-86a5-4305-ad0c-de01f36998ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:07.849109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d315a4-86a5-4305-ad0c-de01f36998ef admin admin] PATH_INFO: `/v3/projects/6dd39a2f4a864a839de65767d2e756fb/users/0c5242da58d043b9baf3add853a47338/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:07.872338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d315a4-86a5-4305-ad0c-de01f36998ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd39a2f4a864a839de65767d2e756fb, user_id=0c5242da58d043b9baf3add853a47338, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:07.873400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-e9d315a4-86a5-4305-ad0c-de01f36998ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:07.873400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Sep 19 11:52:07.873400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: Sep 19 11:52:07.875602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d315a4-86a5-4305-ad0c-de01f36998ef admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:07.900367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 747/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:52:07 2022] PUT /identity/v3/projects/6dd39a2f4a864a839de65767d2e756fb/users/0c5242da58d043b9baf3add853a47338/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:52:07.912363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de1b-3449-45b2-a41c-d06532e6601e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:07.912803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de1b-3449-45b2-a41c-d06532e6601e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:07.913086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de1b-3449-45b2-a41c-d06532e6601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:07.970671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-db17de1b-3449-45b2-a41c-d06532e6601e None None] MFA Rules not processed for user `0c5242da58d043b9baf3add853a47338`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:52:07.971802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db17de1b-3449-45b2-a41c-d06532e6601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:08.048153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 755/1502] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:52:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:52:08.061818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60a0a-3b47-4cff-9628-100635e004f9 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:08.062101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60a0a-3b47-4cff-9628-100635e004f9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:08.062372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60a0a-3b47-4cff-9628-100635e004f9 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:08.063697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 748/1503] 10.222.0.42 () {54 vars in 967 bytes} [Mon Sep 19 11:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:52:08.068525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660815cc-3f4d-4c82-8e92-66d488c57fc7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:08.069433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660815cc-3f4d-4c82-8e92-66d488c57fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:08.069715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660815cc-3f4d-4c82-8e92-66d488c57fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:08.101091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:08.148014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-660815cc-3f4d-4c82-8e92-66d488c57fc7 None None] MFA Rules not processed for user `a82e9cce21e2452ca7977b828a137c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:52:08.149258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-660815cc-3f4d-4c82-8e92-66d488c57fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:08.223279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 756/1504] 10.222.0.42 () {58 vars in 1064 bytes} [Mon Sep 19 11:52:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:52:08.232144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60a0a-3b47-4cff-9628-100635e004f9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:08.233672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-16b60a0a-3b47-4cff-9628-100635e004f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:08.283415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:08.337770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60a0a-3b47-4cff-9628-100635e004f9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:08.412159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:08.413312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:08.413644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:08.413939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:08.415527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:08.514828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:08.516172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:08.519633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:08.534597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 749/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:52:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:52:08.581808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b4535-c9b2-4e02-9054-c38f437784e1 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:08.582092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b4535-c9b2-4e02-9054-c38f437784e1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:08.582363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b4535-c9b2-4e02-9054-c38f437784e1 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:08.583602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 757/1506] 10.222.0.42 () {52 vars in 830 bytes} [Mon Sep 19 11:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:52:08.587367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:08.588544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:08.688272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0d4b9-dc41-4443-a258-502f3db3e9db service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:08.781999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:08.782649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:08.782810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:08.783082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] PATH_INFO: `/v3/users/0c5242da58d043b9baf3add853a47338` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:08.795989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5242da58d043b9baf3add853a47338)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:08.797008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:08.797008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Sep 19 11:52:08.797008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: Sep 19 11:52:08.798239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:08.813721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:08.874073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5242da58d043b9baf3add853a47338'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:08.883870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5242da58d043b9baf3add853a47338'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:08.884467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5242da58d043b9baf3add853a47338'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:08.907577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5242da58d043b9baf3add853a47338'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:08.922657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5242da58d043b9baf3add853a47338'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:08.928766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 750/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:52:08 2022] DELETE /identity/v3/users/0c5242da58d043b9baf3add853a47338 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:52:08.933441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:08.933958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:08.934065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:08.991053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:52:08.992247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:09.066003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:09.079211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 758/1508] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:52:09.089428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:09.090623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:09.190601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96512a-00c7-4655-a2ac-8a7c57c6b9ff admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:09.243817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:09.264489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb79fe-cbb8-4995-9b20-59a858c0aa11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:09.265083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb79fe-cbb8-4995-9b20-59a858c0aa11 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:09.265377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb79fe-cbb8-4995-9b20-59a858c0aa11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:09.265642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb79fe-cbb8-4995-9b20-59a858c0aa11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:09.267210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9fcb79fe-cbb8-4995-9b20-59a858c0aa11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:09.375111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb79fe-cbb8-4995-9b20-59a858c0aa11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:09.376447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb79fe-cbb8-4995-9b20-59a858c0aa11 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:09.395152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 751/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:52:09.725938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:52:09.727239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:52:09.739397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1d9d4-4f81-4ea9-a9c1-9b97e89d2931 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:52:09.844847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:52:09.845512 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:52:09.845794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:52:09.846088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] PATH_INFO: `/v3/projects/6dd39a2f4a864a839de65767d2e756fb` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:52:09.857361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd39a2f4a864a839de65767d2e756fb)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:52:09.858397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:52:09.858397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:52:09.858397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:52:09.859604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:52:09.920750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd39a2f4a864a839de65767d2e756fb', 'request_id': 'req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:09.929272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd39a2f4a864a839de65767d2e756fb', 'request_id': 'req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:09.935577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd39a2f4a864a839de65767d2e756fb', 'request_id': 'req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:09.967133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] The token cache is being invalidate because project 6dd39a2f4a864a839de65767d2e756fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:52:09.967418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:09.967842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0506d297-1e1a-4394-8a00-c2ecaf5c6a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:52:09.969243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 759/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:52:09 2022] DELETE /identity/v3/projects/6dd39a2f4a864a839de65767d2e756fb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:52:19.392954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=62 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:19.965186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:49.211389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bb1b6-1611-4bd0-8392-ea6ad1482bd4 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:49.211987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bb1b6-1611-4bd0-8392-ea6ad1482bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:49.211987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bb1b6-1611-4bd0-8392-ea6ad1482bd4 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:49.213406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:53:49.218364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83aa66-5886-4ede-a98e-86684379cc71 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:49.218838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83aa66-5886-4ede-a98e-86684379cc71 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:49.218967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83aa66-5886-4ede-a98e-86684379cc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:49.302301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-da83aa66-5886-4ede-a98e-86684379cc71 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:53:49.303510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-da83aa66-5886-4ede-a98e-86684379cc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:53:49.407171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:53:49.566997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bb1b6-1611-4bd0-8392-ea6ad1482bd4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:53:49.569069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9e4bb1b6-1611-4bd0-8392-ea6ad1482bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:53:49.688195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bb1b6-1611-4bd0-8392-ea6ad1482bd4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:53:49.694049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72e507-d2e4-4950-bfe8-02dba294ed2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:53:49.694650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e507-d2e4-4950-bfe8-02dba294ed2a service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:49.694936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e507-d2e4-4950-bfe8-02dba294ed2a service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:49.695209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e507-d2e4-4950-bfe8-02dba294ed2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:49.703106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e507-d2e4-4950-bfe8-02dba294ed2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:53:49.704663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e507-d2e4-4950-bfe8-02dba294ed2a service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:53:49.714210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 753/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:53:50.801477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a379-d683-49e8-8421-b2ef26cf278f None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:50.802032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a379-d683-49e8-8421-b2ef26cf278f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:50.802032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a379-d683-49e8-8421-b2ef26cf278f None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:50.803267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:53:50.809752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9339b-5f95-4419-8898-f64a72e248f0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:50.810235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9339b-5f95-4419-8898-f64a72e248f0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:50.810347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9339b-5f95-4419-8898-f64a72e248f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:50.830369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-61d9339b-5f95-4419-8898-f64a72e248f0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:53:50.831682 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-61d9339b-5f95-4419-8898-f64a72e248f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:53:50.839405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:53:50.983977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88c236-8b35-4222-9ae2-e6534b48d8bc None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:50.984259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88c236-8b35-4222-9ae2-e6534b48d8bc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:50.984535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88c236-8b35-4222-9ae2-e6534b48d8bc None None] PATH_INFO: `/v3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:50.985848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 762/1516] 10.222.0.95 () {54 vars in 925 bytes} [Mon Sep 19 11:53:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:53:50.995335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9339b-5f95-4419-8898-f64a72e248f0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:53:50.998609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00fa5-ddd1-40a6-bdd4-c458c927f067 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:50.998987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00fa5-ddd1-40a6-bdd4-c458c927f067 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:50.999338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00fa5-ddd1-40a6-bdd4-c458c927f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:51.008129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9339b-5f95-4419-8898-f64a72e248f0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:53:51.013646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300262ad-aa2b-44bc-a70e-d71f06cdbd03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:53:51.014268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300262ad-aa2b-44bc-a70e-d71f06cdbd03 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:53:51.014543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300262ad-aa2b-44bc-a70e-d71f06cdbd03 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:53:51.014812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300262ad-aa2b-44bc-a70e-d71f06cdbd03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:53:51.024097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300262ad-aa2b-44bc-a70e-d71f06cdbd03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:53:51.025704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300262ad-aa2b-44bc-a70e-d71f06cdbd03 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:53:51.035237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 755/1517] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:53:51.060829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-92e00fa5-ddd1-40a6-bdd4-c458c927f067 None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:53:51.062001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-92e00fa5-ddd1-40a6-bdd4-c458c927f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:53:51.095672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:51.141524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 763/1518] 10.222.0.95 () {58 vars in 1015 bytes} [Mon Sep 19 11:53:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:00.000804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331c9e8-5d72-4dd1-9ed9-dd520389f3ee None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:00.001257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331c9e8-5d72-4dd1-9ed9-dd520389f3ee None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:00.001379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331c9e8-5d72-4dd1-9ed9-dd520389f3ee None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:00.003275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 756/1519] 10.222.0.42 () {54 vars in 961 bytes} [Mon Sep 19 11:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:54:00.008441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cf5c-4627-4e63-b0ff-d39b1dff31a6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:00.008851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cf5c-4627-4e63-b0ff-d39b1dff31a6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:00.009018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cf5c-4627-4e63-b0ff-d39b1dff31a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:00.029411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-eec0cf5c-4627-4e63-b0ff-d39b1dff31a6 None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:54:00.030602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-eec0cf5c-4627-4e63-b0ff-d39b1dff31a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:00.039074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 764/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Sep 19 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:00.046672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331c9e8-5d72-4dd1-9ed9-dd520389f3ee None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:54:00.060105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331c9e8-5d72-4dd1-9ed9-dd520389f3ee None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:54:00.065540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ac96e-53a9-43c3-a223-4e9cd5af4079 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:54:00.066122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ac96e-53a9-43c3-a223-4e9cd5af4079 service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:00.066396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ac96e-53a9-43c3-a223-4e9cd5af4079 service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:00.066663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ac96e-53a9-43c3-a223-4e9cd5af4079 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:00.074688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ac96e-53a9-43c3-a223-4e9cd5af4079 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:54:00.076237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ac96e-53a9-43c3-a223-4e9cd5af4079 service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:54:00.086305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 757/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:54:02.530061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9a667-3a97-45c3-b272-f62357de918c None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:02.530637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9a667-3a97-45c3-b272-f62357de918c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:02.530637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9a667-3a97-45c3-b272-f62357de918c None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:02.531985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:54:02.538317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a619-c586-40d6-93dc-cc6c5add428a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:02.538769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a619-c586-40d6-93dc-cc6c5add428a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:02.538950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a619-c586-40d6-93dc-cc6c5add428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:02.558441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8493a619-c586-40d6-93dc-cc6c5add428a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:54:02.559628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8493a619-c586-40d6-93dc-cc6c5add428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:02.568032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:02.725463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9a667-3a97-45c3-b272-f62357de918c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:54:02.741279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9a667-3a97-45c3-b272-f62357de918c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:54:02.746671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b790b4-91a6-49d2-839c-61b398b99706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:54:02.747265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b790b4-91a6-49d2-839c-61b398b99706 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:02.747549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b790b4-91a6-49d2-839c-61b398b99706 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:02.747821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b790b4-91a6-49d2-839c-61b398b99706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:02.756591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b790b4-91a6-49d2-839c-61b398b99706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:54:02.758222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b790b4-91a6-49d2-839c-61b398b99706 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:54:02.767938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 766/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:54:03.866802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607126-2b5f-45dc-9317-02657b167cd6 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:03.867397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607126-2b5f-45dc-9317-02657b167cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:03.867397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607126-2b5f-45dc-9317-02657b167cd6 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:03.868741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:54:03.874717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ed05a-354d-4f70-80aa-c4802f6b1854 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:03.875144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ed05a-354d-4f70-80aa-c4802f6b1854 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:03.875262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ed05a-354d-4f70-80aa-c4802f6b1854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:03.896422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-388ed05a-354d-4f70-80aa-c4802f6b1854 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:54:03.897652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-388ed05a-354d-4f70-80aa-c4802f6b1854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:03.905456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:04.058218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607126-2b5f-45dc-9317-02657b167cd6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:54:04.073111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607126-2b5f-45dc-9317-02657b167cd6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:54:04.078528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c5809-8703-4c9c-94ce-8af7cbf679d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:54:04.079115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c5809-8703-4c9c-94ce-8af7cbf679d4 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:04.079394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c5809-8703-4c9c-94ce-8af7cbf679d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:04.079666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c5809-8703-4c9c-94ce-8af7cbf679d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:04.087799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c5809-8703-4c9c-94ce-8af7cbf679d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:54:04.089401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c5809-8703-4c9c-94ce-8af7cbf679d4 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:54:04.098693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 760/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:54:08.395666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb03c5-c8df-4403-ae06-b4bd5fbc97e5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:08.396235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb03c5-c8df-4403-ae06-b4bd5fbc97e5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:08.396235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb03c5-c8df-4403-ae06-b4bd5fbc97e5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:08.397625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:54:08.402767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749b85a-73c2-4fa1-8448-cd951f0359cb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:08.403228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749b85a-73c2-4fa1-8448-cd951f0359cb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:08.403336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749b85a-73c2-4fa1-8448-cd951f0359cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:08.422818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5749b85a-73c2-4fa1-8448-cd951f0359cb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:54:08.424002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5749b85a-73c2-4fa1-8448-cd951f0359cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:08.431883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:08.719411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb03c5-c8df-4403-ae06-b4bd5fbc97e5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:54:08.721764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4fcb03c5-c8df-4403-ae06-b4bd5fbc97e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:08.799373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb03c5-c8df-4403-ae06-b4bd5fbc97e5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:54:08.802886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddac87-ec95-4f9a-98a7-fdb971d4e550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:54:08.803481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddac87-ec95-4f9a-98a7-fdb971d4e550 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:08.803760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddac87-ec95-4f9a-98a7-fdb971d4e550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:08.804030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddac87-ec95-4f9a-98a7-fdb971d4e550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:08.812849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddac87-ec95-4f9a-98a7-fdb971d4e550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:54:08.814297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddac87-ec95-4f9a-98a7-fdb971d4e550 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:54:08.823581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 769/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:54:10.989836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242c87-89e9-475e-bc97-7388f8222ed1 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:10.990427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242c87-89e9-475e-bc97-7388f8222ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:10.990427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242c87-89e9-475e-bc97-7388f8222ed1 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:10.992258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:54:10.997959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcda6d1-8598-4c3c-b0ed-6f56a6b309b1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:10.998445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcda6d1-8598-4c3c-b0ed-6f56a6b309b1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:10.998548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcda6d1-8598-4c3c-b0ed-6f56a6b309b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:11.019081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5bcda6d1-8598-4c3c-b0ed-6f56a6b309b1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:54:11.020265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5bcda6d1-8598-4c3c-b0ed-6f56a6b309b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:11.027958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:11.323193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242c87-89e9-475e-bc97-7388f8222ed1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:54:11.334025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242c87-89e9-475e-bc97-7388f8222ed1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:54:11.337538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7396c-d3a3-4045-915a-4b4fac007c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:54:11.338132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7396c-d3a3-4045-915a-4b4fac007c47 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:11.338410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7396c-d3a3-4045-915a-4b4fac007c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:11.338688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7396c-d3a3-4045-915a-4b4fac007c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:11.347940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7396c-d3a3-4045-915a-4b4fac007c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:54:11.349395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7396c-d3a3-4045-915a-4b4fac007c47 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:54:11.358753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 763/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:54:15.047649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe887-9f82-4136-9378-9d635383e824 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:15.048223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe887-9f82-4136-9378-9d635383e824 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:15.048223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe887-9f82-4136-9378-9d635383e824 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:15.050106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:54:15.055574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cf47d-38c4-4ff7-8f88-2e8ad9eefdf0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:15.055998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cf47d-38c4-4ff7-8f88-2e8ad9eefdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:15.056117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cf47d-38c4-4ff7-8f88-2e8ad9eefdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:15.076700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2f8cf47d-38c4-4ff7-8f88-2e8ad9eefdf0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:54:15.077999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2f8cf47d-38c4-4ff7-8f88-2e8ad9eefdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:15.086381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:15.397321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe887-9f82-4136-9378-9d635383e824 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:54:15.398994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-826fe887-9f82-4136-9378-9d635383e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:15.479332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe887-9f82-4136-9378-9d635383e824 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:54:15.483188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8c656-d708-4def-b5e0-e386d872a819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:54:15.483782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c656-d708-4def-b5e0-e386d872a819 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:15.484059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c656-d708-4def-b5e0-e386d872a819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:15.484330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8c656-d708-4def-b5e0-e386d872a819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:15.491841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:15.494386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8c656-d708-4def-b5e0-e386d872a819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:54:15.496152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8c656-d708-4def-b5e0-e386d872a819 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:54:15.506493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 772/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:54:17.676835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884340-467d-4731-a1fe-8da411153ea7 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:17.677362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884340-467d-4731-a1fe-8da411153ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:17.677469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43884340-467d-4731-a1fe-8da411153ea7 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:17.678732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:54:17.684014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643cea-8465-425c-801a-6ab97012a1dc None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:17.684449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643cea-8465-425c-801a-6ab97012a1dc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:17.684554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f643cea-8465-425c-801a-6ab97012a1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:17.704604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7f643cea-8465-425c-801a-6ab97012a1dc None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:54:17.705926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7f643cea-8465-425c-801a-6ab97012a1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:17.713777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:54:18.019412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884340-467d-4731-a1fe-8da411153ea7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:54:18.021064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-43884340-467d-4731-a1fe-8da411153ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:54:18.033697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43884340-467d-4731-a1fe-8da411153ea7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:54:18.037133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c6bdf-6f0a-4394-a37b-fd3073f31ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:54:18.037736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c6bdf-6f0a-4394-a37b-fd3073f31ecb service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:54:18.038006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c6bdf-6f0a-4394-a37b-fd3073f31ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:54:18.038269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c6bdf-6f0a-4394-a37b-fd3073f31ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:54:18.047141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c6bdf-6f0a-4394-a37b-fd3073f31ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:54:18.048535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c6bdf-6f0a-4394-a37b-fd3073f31ecb service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:54:18.057786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 766/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:54:27.699603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:28.053572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:53.788939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17645fa-de39-44df-a65e-0f280c365853 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:53.791104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17645fa-de39-44df-a65e-0f280c365853 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:53.791912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17645fa-de39-44df-a65e-0f280c365853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:53.837688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b17645fa-de39-44df-a65e-0f280c365853 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:53.840077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b17645fa-de39-44df-a65e-0f280c365853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:53.859704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 774/1540] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:53.869192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7975-d970-4da3-8d93-b07682a06d50 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:53.870588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7975-d970-4da3-8d93-b07682a06d50 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:53.870588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7975-d970-4da3-8d93-b07682a06d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:53.918572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d29f7975-d970-4da3-8d93-b07682a06d50 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:53.920888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d29f7975-d970-4da3-8d93-b07682a06d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:53.938955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 767/1541] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:55:53.944258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17645fa-de39-44df-a65e-0f280c365853 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:53.963647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17645fa-de39-44df-a65e-0f280c365853 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:53.972850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15e3a0-e26b-4f1e-9355-9ff983e5488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:53.974249 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e3a0-e26b-4f1e-9355-9ff983e5488e admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:53.975057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e3a0-e26b-4f1e-9355-9ff983e5488e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:53.975860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e3a0-e26b-4f1e-9355-9ff983e5488e admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:53.977943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e3a0-e26b-4f1e-9355-9ff983e5488e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:53.978800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e3a0-e26b-4f1e-9355-9ff983e5488e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:53.982158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e3a0-e26b-4f1e-9355-9ff983e5488e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.013582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 775/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:55:54.022228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f7975-d970-4da3-8d93-b07682a06d50 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.042744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f7975-d970-4da3-8d93-b07682a06d50 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.047028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526f0cd-df17-4d7e-8ee6-a28f68a9de40 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.047846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526f0cd-df17-4d7e-8ee6-a28f68a9de40 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.048697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526f0cd-df17-4d7e-8ee6-a28f68a9de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.072271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a1bc-5177-4cae-bd83-0c9127485491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.076277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a1bc-5177-4cae-bd83-0c9127485491 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.077058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a1bc-5177-4cae-bd83-0c9127485491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.081915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a1bc-5177-4cae-bd83-0c9127485491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.084811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a1bc-5177-4cae-bd83-0c9127485491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.096821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a1bc-5177-4cae-bd83-0c9127485491 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.112634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2526f0cd-df17-4d7e-8ee6-a28f68a9de40 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.113895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2526f0cd-df17-4d7e-8ee6-a28f68a9de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.140174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 776/1543] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:55:54.165425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e522-0b69-41a7-8d38-3942cd3796ae None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.165734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e522-0b69-41a7-8d38-3942cd3796ae None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.166055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e522-0b69-41a7-8d38-3942cd3796ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.213278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ea31e522-0b69-41a7-8d38-3942cd3796ae None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.213278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ea31e522-0b69-41a7-8d38-3942cd3796ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.223815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 768/1544] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/projects => generated 391 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:54.228604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7967b-b55c-4f0e-810e-b46112837335 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.229485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7967b-b55c-4f0e-810e-b46112837335 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.230055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 777/1545] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:55:54.230591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7967b-b55c-4f0e-810e-b46112837335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.231024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e522-0b69-41a7-8d38-3942cd3796ae None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.249037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e522-0b69-41a7-8d38-3942cd3796ae None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.278920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e5e7967b-b55c-4f0e-810e-b46112837335 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.281491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e5e7967b-b55c-4f0e-810e-b46112837335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.367135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99188c1a-1785-44c7-8c20-18ffb635a697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.368436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99188c1a-1785-44c7-8c20-18ffb635a697 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.368866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99188c1a-1785-44c7-8c20-18ffb635a697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.369345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99188c1a-1785-44c7-8c20-18ffb635a697 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.370129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99188c1a-1785-44c7-8c20-18ffb635a697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.372199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99188c1a-1785-44c7-8c20-18ffb635a697 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.416081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 778/1546] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:54.418833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e572c-aa6a-440b-b163-cfa9ac7cbbd2 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.419129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e572c-aa6a-440b-b163-cfa9ac7cbbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.419404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e572c-aa6a-440b-b163-cfa9ac7cbbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.454032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1b4e572c-aa6a-440b-b163-cfa9ac7cbbd2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.455090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 769/1547] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:54.455279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1b4e572c-aa6a-440b-b163-cfa9ac7cbbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.457045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7967b-b55c-4f0e-810e-b46112837335 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.479640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 779/1548] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:54.480668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e572c-aa6a-440b-b163-cfa9ac7cbbd2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.483298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7967b-b55c-4f0e-810e-b46112837335 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.491633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e572c-aa6a-440b-b163-cfa9ac7cbbd2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.497066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f2e74-2676-4fdf-89a1-2d77f3bb830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.498706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f2e74-2676-4fdf-89a1-2d77f3bb830a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.499579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f2e74-2676-4fdf-89a1-2d77f3bb830a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.500360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f2e74-2676-4fdf-89a1-2d77f3bb830a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.507354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f2e74-2676-4fdf-89a1-2d77f3bb830a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.508123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.508757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.509205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.509378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.510156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:54.510452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.512282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.514981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f2e74-2676-4fdf-89a1-2d77f3bb830a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.542885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 780/1549] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:55:54.543788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.563830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 770/1550] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:54.568420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce211-b7c8-4f0a-9a45-9c6424164ab2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.568882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce211-b7c8-4f0a-9a45-9c6424164ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.569389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce211-b7c8-4f0a-9a45-9c6424164ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.572948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e21362-014f-4f39-91cc-da30a5efc821 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.598983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.599609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.599899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.600162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.600809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:54.601138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.603884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.619303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a39ce211-b7c8-4f0a-9a45-9c6424164ab2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.621200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a39ce211-b7c8-4f0a-9a45-9c6424164ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.638334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 781/1551] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:55:54.642588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 771/1552] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:54.643884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce211-b7c8-4f0a-9a45-9c6424164ab2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.645347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.691595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3179-287c-41a0-8606-40a5a97cf32b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.696827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce211-b7c8-4f0a-9a45-9c6424164ab2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.710435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c1a7a-f009-4ee0-a348-1e6a201c6e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.711752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1a7a-f009-4ee0-a348-1e6a201c6e4d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.713334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3aafbc-3397-4a1f-b0f9-929852e4a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.714326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aafbc-3397-4a1f-b0f9-929852e4a6fd admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.714807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aafbc-3397-4a1f-b0f9-929852e4a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.715271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3aafbc-3397-4a1f-b0f9-929852e4a6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.716423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aafbc-3397-4a1f-b0f9-929852e4a6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.719458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3aafbc-3397-4a1f-b0f9-929852e4a6fd admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.721817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1a7a-f009-4ee0-a348-1e6a201c6e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.722271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1a7a-f009-4ee0-a348-1e6a201c6e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.723468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c1a7a-f009-4ee0-a348-1e6a201c6e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.728176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c1a7a-f009-4ee0-a348-1e6a201c6e4d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.754813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 782/1553] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:54.756013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00549510-a103-4af8-8205-1d94c01d574f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.756325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00549510-a103-4af8-8205-1d94c01d574f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.756578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00549510-a103-4af8-8205-1d94c01d574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.792236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-00549510-a103-4af8-8205-1d94c01d574f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.795589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-00549510-a103-4af8-8205-1d94c01d574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.796026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 772/1554] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:54.798224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86bcb7-4e8c-4638-b731-79872152ddcd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.798531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86bcb7-4e8c-4638-b731-79872152ddcd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.798918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86bcb7-4e8c-4638-b731-79872152ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.826628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-df86bcb7-4e8c-4638-b731-79872152ddcd None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.828022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-df86bcb7-4e8c-4638-b731-79872152ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.895887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 783/1555] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:54.896743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00549510-a103-4af8-8205-1d94c01d574f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.908668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00549510-a103-4af8-8205-1d94c01d574f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.912869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 773/1556] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:54.914185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da122f5e-2ad7-43ac-83ac-4c39276a9728 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.914598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da122f5e-2ad7-43ac-83ac-4c39276a9728 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.915052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da122f5e-2ad7-43ac-83ac-4c39276a9728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.917608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:54.918224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:54.918551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:54.918868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:54.919502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:54.920536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:55:54.920536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:55:54.920536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:55:54.921814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:54.934600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:54.936071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-da122f5e-2ad7-43ac-83ac-4c39276a9728 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:54.937328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-da122f5e-2ad7-43ac-83ac-4c39276a9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:54.945424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 774/1557] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:54.950014 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da122f5e-2ad7-43ac-83ac-4c39276a9728 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.955762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 784/1558] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:54.955762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:54.959857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da122f5e-2ad7-43ac-83ac-4c39276a9728 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:54.972423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:55.018617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbef7e2-4038-46ed-9317-b8685d36acd1 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.020221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f93326-7267-4306-a38a-47aab13f595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.020887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f93326-7267-4306-a38a-47aab13f595c admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.021191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f93326-7267-4306-a38a-47aab13f595c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.021469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f93326-7267-4306-a38a-47aab13f595c admin admin] PATH_INFO: `/v3/projects/aabef64303b8442db6510185a2e83b5e/users/9cba47a204da4d49b6e6313052f4c579/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.023311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddc24a-d6ee-4802-ac30-9579ff83df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.024064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddc24a-d6ee-4802-ac30-9579ff83df1d admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.024341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddc24a-d6ee-4802-ac30-9579ff83df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.024704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddc24a-d6ee-4802-ac30-9579ff83df1d admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.025395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddc24a-d6ee-4802-ac30-9579ff83df1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.027306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddc24a-d6ee-4802-ac30-9579ff83df1d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.036596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f93326-7267-4306-a38a-47aab13f595c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabef64303b8442db6510185a2e83b5e, user_id=9cba47a204da4d49b6e6313052f4c579, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.039566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f93326-7267-4306-a38a-47aab13f595c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.051980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 785/1559] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:54 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.053424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f4c0-027b-49d6-86d5-ba2981fb4bac None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.057819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 775/1560] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:54 2022] PUT /identity/v3/projects/aabef64303b8442db6510185a2e83b5e/users/9cba47a204da4d49b6e6313052f4c579/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:55.058009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f4c0-027b-49d6-86d5-ba2981fb4bac None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.058009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f4c0-027b-49d6-86d5-ba2981fb4bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.058215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a03e-25b8-4941-9174-ee25134015eb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.058215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a03e-25b8-4941-9174-ee25134015eb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.058215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a03e-25b8-4941-9174-ee25134015eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.075529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6633f4c0-027b-49d6-86d5-ba2981fb4bac None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:55.076736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6633f4c0-027b-49d6-86d5-ba2981fb4bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:55.078493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5759a03e-25b8-4941-9174-ee25134015eb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:55.079669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5759a03e-25b8-4941-9174-ee25134015eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:55.138983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 786/1561] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:55.140265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbe2f7-bc9b-4264-8577-b1eeed89c431 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.140551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbe2f7-bc9b-4264-8577-b1eeed89c431 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.140825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbe2f7-bc9b-4264-8577-b1eeed89c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.141330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 776/1562] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:55.146217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759a03e-25b8-4941-9174-ee25134015eb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.157429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759a03e-25b8-4941-9174-ee25134015eb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.161721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-09cbe2f7-bc9b-4264-8577-b1eeed89c431 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:55.162279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.162887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.163016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-09cbe2f7-bc9b-4264-8577-b1eeed89c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:55.163161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.163429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.164088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:55.164946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.165998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:55:55.165998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Sep 19 11:55:55.165998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: Sep 19 11:55:55.166876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.172434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 787/1563] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:55.173700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243addc4-f014-4f6d-ad5c-3b43be9dd5d5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.173990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243addc4-f014-4f6d-ad5c-3b43be9dd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.174255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243addc4-f014-4f6d-ad5c-3b43be9dd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.182040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 777/1564] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:55:55.182750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.192437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60628741-0130-4bd3-89dd-aaaeee626804 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.193774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-243addc4-f014-4f6d-ad5c-3b43be9dd5d5 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:55.194992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-243addc4-f014-4f6d-ad5c-3b43be9dd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:55.197646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5ce08-023c-4a95-8dce-aa75717e3b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.198239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ce08-023c-4a95-8dce-aa75717e3b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.198517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ce08-023c-4a95-8dce-aa75717e3b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.198784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ce08-023c-4a95-8dce-aa75717e3b09 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.199447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5ce08-023c-4a95-8dce-aa75717e3b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.200399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-80a5ce08-023c-4a95-8dce-aa75717e3b09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:55:55.200399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Sep 19 11:55:55.200399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: Sep 19 11:55:55.201625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5ce08-023c-4a95-8dce-aa75717e3b09 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.203913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 788/1565] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:55.204770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243addc4-f014-4f6d-ad5c-3b43be9dd5d5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.215229 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243addc4-f014-4f6d-ad5c-3b43be9dd5d5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.220853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8be836-d786-40d1-a95a-a58b4c51add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.221484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8be836-d786-40d1-a95a-a58b4c51add0 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.221765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8be836-d786-40d1-a95a-a58b4c51add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.222037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8be836-d786-40d1-a95a-a58b4c51add0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.222676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8be836-d786-40d1-a95a-a58b4c51add0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.224262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8be836-d786-40d1-a95a-a58b4c51add0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.224627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 778/1566] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.225876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78433735-b88c-40b9-8506-25d7e719d45b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.226157 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78433735-b88c-40b9-8506-25d7e719d45b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.226428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78433735-b88c-40b9-8506-25d7e719d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.237738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 789/1567] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:55.242175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f540d-0dc5-40f1-9e3f-6ec144f50b1a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.242550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f540d-0dc5-40f1-9e3f-6ec144f50b1a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.243006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f540d-0dc5-40f1-9e3f-6ec144f50b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.245352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-78433735-b88c-40b9-8506-25d7e719d45b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:55.246547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-78433735-b88c-40b9-8506-25d7e719d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:55.254196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 779/1568] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:55.259269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31c0de-0343-4e1a-a845-95d59227a14a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.259269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31c0de-0343-4e1a-a845-95d59227a14a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.259581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31c0de-0343-4e1a-a845-95d59227a14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.265260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1a4f540d-0dc5-40f1-9e3f-6ec144f50b1a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:55.266462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1a4f540d-0dc5-40f1-9e3f-6ec144f50b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:55.274811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 790/1569] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:55.275563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f540d-0dc5-40f1-9e3f-6ec144f50b1a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.282649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8f31c0de-0343-4e1a-a845-95d59227a14a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:55.283853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8f31c0de-0343-4e1a-a845-95d59227a14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:55.285284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f540d-0dc5-40f1-9e3f-6ec144f50b1a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.290455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.291048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.291327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.291598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.292245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:55.292351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 780/1570] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:55.292615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.293961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31c0de-0343-4e1a-a845-95d59227a14a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.294321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.304038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31c0de-0343-4e1a-a845-95d59227a14a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.307401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 791/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:55:55.309053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.315943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.316851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.317129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.317427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.318107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.320466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.322168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8524-ca7d-4abe-938e-29abc7248bc7 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.327293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.328048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.328421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.328697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.329381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:55.329681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.331562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.344560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 792/1572] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:55:55.345464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.353322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 781/1573] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.354406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.356280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f849e-52c2-4c7a-816d-776dd1ceb67d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.377046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:55.395322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:55.416669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.417317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.417594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.417862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.418503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.420088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.421128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4a08-741d-492c-98d0-79557b0a4137 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.425785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.426387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.426664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.426933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.427581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.429174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.433255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 793/1574] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:55.433255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.443078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 782/1575] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:55.443078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.452305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3ed0-04e9-4caf-ab87-f06d49edc060 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.457543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.458151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.458426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.458697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.459345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:55.459645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.461843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.474127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 783/1576] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:55:55.474127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.491522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2115f2-316f-4b39-aa8b-78d9442d4801 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.493295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb753779-c72b-4c20-87cf-a470dd4dbfd6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.496389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.496950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.497212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.497506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.497642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.497829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.497958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.498243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.498584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:55:55.498893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.500497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.507978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.509914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.513207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 784/1577] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:55:55.514218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.519803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 794/1578] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:55.520502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.527895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4858b8-17f9-41bb-b74a-652d2856b760 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.530718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379588ef-a509-468f-97b6-db84cde93a04 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.532846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.533684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.534023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.534355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.534921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.536847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.538466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.539331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.539786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.540197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.540995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.543119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.570345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 785/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.571962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.576537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 795/1580] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.577855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.650721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f576fc-a5e3-444b-a470-d86d542674c6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.656341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.657011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.657323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.657782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.658047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8bf3b-b9fd-43f0-932c-01ad3dd1f361 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.658434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.660089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.668453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.669083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.669681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.669955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.670641 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.672556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.672682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 796/1581] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:55.673836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.688634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a82e8-805b-4161-84de-7e1ba88c6ed7 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.693796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.694460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.694752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.694994 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] PATH_INFO: `/v3/projects/60bc964331f849ea8322b96493b72f23/users/9520fd95910e462ea59184dd0dfb1bb2/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.706010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 786/1582] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.707275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.713521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bc964331f849ea8322b96493b72f23, user_id=9520fd95910e462ea59184dd0dfb1bb2, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.714644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:55:55.714644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:55:55.714644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:55:55.716745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.720470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fb32-af08-4e8d-8767-1bde47fa392d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.725437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.726052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.726332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.726604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.727452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.730063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.739834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 797/1583] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:55 2022] PUT /identity/v3/projects/60bc964331f849ea8322b96493b72f23/users/9520fd95910e462ea59184dd0dfb1bb2/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:55.740722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.764193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:55.783011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 787/1584] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.784082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.832524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d7ca-3cbb-4e8b-b015-b0db0e35ab90 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.847263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:55.864117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af7d0-0c29-470e-81bb-013a3d02ce03 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.869424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.870050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.870553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.870757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.871492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.873812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.906165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.906998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.907380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.907739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.908477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.908740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 788/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.909950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.910957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.924059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eafa9-f019-4f4d-badb-5dcc262e862d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:55.931028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:55.931793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:55.932087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:55.932504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:55.933175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:55.935741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:55.944233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 798/1586] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.946156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.965548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 789/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:55 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:55.966949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:55.983670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc5272-27f2-40a6-bd51-e583ac6dea2f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.031028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55360593-0b3b-4c87-ac1a-f52bea36d899 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.036054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8711-a199-4b53-b68a-bc198644fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.036812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8711-a199-4b53-b68a-bc198644fa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.037116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8711-a199-4b53-b68a-bc198644fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.037426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8711-a199-4b53-b68a-bc198644fa69 admin admin] PATH_INFO: `/v3/projects/3917a61200334f50856af256944d3123/users/75e559b4614942bc99fee77672024d9e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.054504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b8711-a199-4b53-b68a-bc198644fa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3917a61200334f50856af256944d3123, user_id=75e559b4614942bc99fee77672024d9e, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.058782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b8711-a199-4b53-b68a-bc198644fa69 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.063129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.063750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.064076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.064392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.065229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.066838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.075446 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 799/1588] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:55 2022] PUT /identity/v3/projects/3917a61200334f50856af256944d3123/users/75e559b4614942bc99fee77672024d9e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:56.076944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e33061-dafd-4ca8-8f27-95e11cc6e100 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.077337 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e33061-dafd-4ca8-8f27-95e11cc6e100 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.077834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e33061-dafd-4ca8-8f27-95e11cc6e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.081521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 790/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.085802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.096935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c08b9f-b90b-46a6-8d31-b67ab58e9d4d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.115192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-90e33061-dafd-4ca8-8f27-95e11cc6e100 None None] MFA Rules not processed for user `9520fd95910e462ea59184dd0dfb1bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:56.116540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-90e33061-dafd-4ca8-8f27-95e11cc6e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:56.139238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:56.173079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.173823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.174371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.174646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.175351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.177386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.210380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 791/1590] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:56 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:56.210380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.215937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 800/1591] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:56.216810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e33061-dafd-4ca8-8f27-95e11cc6e100 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.229429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb9a6-95ef-47a1-9598-4877e71122d7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.230476 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e33061-dafd-4ca8-8f27-95e11cc6e100 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.235206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.236373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.236745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.237117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.238071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc563aa-3cb0-4612-99bf-6e7a9350f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.238275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.238822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc563aa-3cb0-4612-99bf-6e7a9350f77d admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.239093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc563aa-3cb0-4612-99bf-6e7a9350f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.240029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc563aa-3cb0-4612-99bf-6e7a9350f77d admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.240802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.240968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc563aa-3cb0-4612-99bf-6e7a9350f77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.243953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc563aa-3cb0-4612-99bf-6e7a9350f77d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.257750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 792/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.257750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.271082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0dc90-8824-4573-9e66-29b2626f3546 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.277759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.278579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.278953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.279319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.280523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.281808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.297259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 793/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.298357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.301093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 801/1594] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:56 2022] POST /identity/v3/users => generated 291 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:56.302576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9eb6-80e8-4850-a3c2-5ba4c29b8170 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.302864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9eb6-80e8-4850-a3c2-5ba4c29b8170 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.303139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9eb6-80e8-4850-a3c2-5ba4c29b8170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.312568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634317d-d518-44b2-a318-c1f75bd8a861 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.317526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.318278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.318786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.319157 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.319895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.322190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.334501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 794/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.339258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.342725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5f1b9eb6-80e8-4850-a3c2-5ba4c29b8170 None None] MFA Rules not processed for user `75e559b4614942bc99fee77672024d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:56.344214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5f1b9eb6-80e8-4850-a3c2-5ba4c29b8170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:56.354627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f83f1-afc3-4471-bc8c-9a0afb630b02 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.361394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad0ff0-e55c-4732-be87-3977d087cbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.362175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0ff0-e55c-4732-be87-3977d087cbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.362498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0ff0-e55c-4732-be87-3977d087cbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.362814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0ff0-e55c-4732-be87-3977d087cbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.363655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad0ff0-e55c-4732-be87-3977d087cbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.365674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad0ff0-e55c-4732-be87-3977d087cbd1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.382294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 795/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.383907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368eb2-f239-4b67-be86-59a177b37d9a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.384199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368eb2-f239-4b67-be86-59a177b37d9a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.384452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c368eb2-f239-4b67-be86-59a177b37d9a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.387194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 796/1597] 10.222.0.42 () {54 vars in 965 bytes} [Mon Sep 19 11:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:55:56.387194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368eb2-f239-4b67-be86-59a177b37d9a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.402818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:56.411400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c368eb2-f239-4b67-be86-59a177b37d9a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.423453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.424397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.425437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.425873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.426804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.428808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.440390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 802/1598] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:56.441280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9eb6-80e8-4850-a3c2-5ba4c29b8170 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.443679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 797/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.444859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.454797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9eb6-80e8-4850-a3c2-5ba4c29b8170 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.461953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.462705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.463067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.463378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.463710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e324-f2d8-4220-83a3-f7945607d36a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.464072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.465930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.468640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.469431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.469691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.469957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.470594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.472292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.477566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 803/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.478483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.484588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 798/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.485555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.491240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5dd6-924b-48e0-b48d-51c2c523dbf4 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.497550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b568-af44-4a21-a1e4-ae10dbd26075 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.498194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.499072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.499501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.499934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] PATH_INFO: `/v3/projects/d8108a0bbb5f4f5b83bfd0f49d696280/users/3b60e6b12ee9473ba844f752c21e7ea0/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.502335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ecf9-723b-4289-9e95-94f773c3cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.503055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ecf9-723b-4289-9e95-94f773c3cd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.503332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ecf9-723b-4289-9e95-94f773c3cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.503600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ecf9-723b-4289-9e95-94f773c3cd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.504351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ecf9-723b-4289-9e95-94f773c3cd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.506138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ecf9-723b-4289-9e95-94f773c3cd86 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.520382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 799/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.520382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c01f-0725-4b83-94b5-d47014d664cf None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.520382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c01f-0725-4b83-94b5-d47014d664cf None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.520382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c01f-0725-4b83-94b5-d47014d664cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.524826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8108a0bbb5f4f5b83bfd0f49d696280, user_id=3b60e6b12ee9473ba844f752c21e7ea0, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.527810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.549246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 804/1603] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:56 2022] PUT /identity/v3/projects/d8108a0bbb5f4f5b83bfd0f49d696280/users/3b60e6b12ee9473ba844f752c21e7ea0/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:56.551590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.575773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a9f9c01f-0725-4b83-94b5-d47014d664cf None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:56.577571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a9f9c01f-0725-4b83-94b5-d47014d664cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:56.643346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:56.654125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60831095-a482-4e7f-bfe0-aad902265147 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.660021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.660753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.661212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.661608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.662448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.665378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.675059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 800/1604] 10.222.0.42 () {58 vars in 1062 bytes} [Mon Sep 19 11:55:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:56.676051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c01f-0725-4b83-94b5-d47014d664cf None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.687697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c01f-0725-4b83-94b5-d47014d664cf None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.693857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.694879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.695275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.696426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] PATH_INFO: `/v3/projects/a6fd6d54dfcb44f6a1546d9c011dbada/users/092e7d9f6d0f4c6984785e05162483ed/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.716252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fd6d54dfcb44f6a1546d9c011dbada, user_id=092e7d9f6d0f4c6984785e05162483ed, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.719319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.720997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 805/1605] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:56 2022] POST /identity/v3/projects => generated 403 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:56.722168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.745052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 801/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:56 2022] PUT /identity/v3/projects/a6fd6d54dfcb44f6a1546d9c011dbada/users/092e7d9f6d0f4c6984785e05162483ed/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:56.745052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.810374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f731e3-5c60-4dbe-8340-88dbd53f5210 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.828526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91f57-56e7-4a44-9958-54ffd929bada admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.836855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.837581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.838111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.838247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.841780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.843879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.863703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 802/1607] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:56.864850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:56.878408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea3e48-6a5c-4610-a217-4d5cb18e1ba5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:56.886431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd984e-3d9e-40b5-8936-39123dc3e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.887359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd984e-3d9e-40b5-8936-39123dc3e27b admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.887826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd984e-3d9e-40b5-8936-39123dc3e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.888106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd984e-3d9e-40b5-8936-39123dc3e27b admin admin] PATH_INFO: `/v3/projects/116ba12a96664da0a7c0429cb40430b0/users/524880f2e8b24ce987a3b5d61bfd5652/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.906471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:56.907202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.907443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.907713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] PATH_INFO: `/v3/projects/fccae6b3f58d44099d536c045bb5e7d8/users/25dc03c038c8440aa9a0dbbd77b4a6d1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.915210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd984e-3d9e-40b5-8936-39123dc3e27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=116ba12a96664da0a7c0429cb40430b0, user_id=524880f2e8b24ce987a3b5d61bfd5652, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.917672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd984e-3d9e-40b5-8936-39123dc3e27b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.935882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:56.943083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccae6b3f58d44099d536c045bb5e7d8, user_id=25dc03c038c8440aa9a0dbbd77b4a6d1, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:56.946043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:56.958522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 803/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:56 2022] PUT /identity/v3/projects/116ba12a96664da0a7c0429cb40430b0/users/524880f2e8b24ce987a3b5d61bfd5652/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:56.962257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c266d4-76e3-4d9a-a773-6a62944177e4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:56.962552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c266d4-76e3-4d9a-a773-6a62944177e4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:56.962829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c266d4-76e3-4d9a-a773-6a62944177e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:56.963251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 806/1609] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:56 2022] PUT /identity/v3/projects/fccae6b3f58d44099d536c045bb5e7d8/users/25dc03c038c8440aa9a0dbbd77b4a6d1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:56.964289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.006363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f9c266d4-76e3-4d9a-a773-6a62944177e4 None None] MFA Rules not processed for user `3b60e6b12ee9473ba844f752c21e7ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:57.008106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f9c266d4-76e3-4d9a-a773-6a62944177e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:57.087544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934a229-87f9-41a6-bafa-4ad8684b3df5 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.096300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3145067-6cee-4761-97a1-a1bb251d4083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.097433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145067-6cee-4761-97a1-a1bb251d4083 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.097768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145067-6cee-4761-97a1-a1bb251d4083 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.098049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145067-6cee-4761-97a1-a1bb251d4083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.100342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 804/1610] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:57.102319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c266d4-76e3-4d9a-a773-6a62944177e4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.113374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:57.187772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c266d4-76e3-4d9a-a773-6a62944177e4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.192807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.193794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.194073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.194390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.195028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.198632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:57.202359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145067-6cee-4761-97a1-a1bb251d4083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.204404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145067-6cee-4761-97a1-a1bb251d4083 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:57.217356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 807/1611] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:57.219842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec82af-49ae-4dd0-8c71-090af06a2909 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.220060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec82af-49ae-4dd0-8c71-090af06a2909 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.220338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec82af-49ae-4dd0-8c71-090af06a2909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.255384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 805/1612] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/users => generated 308 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:57.256534 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.264216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-33ec82af-49ae-4dd0-8c71-090af06a2909 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:57.265845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-33ec82af-49ae-4dd0-8c71-090af06a2909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:57.281420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2efd6-2364-491a-af49-661e1030ca47 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.285360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 808/1613] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:57.288080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96612d4-ded0-4be9-a520-0a23273a2afc None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.288417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96612d4-ded0-4be9-a520-0a23273a2afc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.288683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96612d4-ded0-4be9-a520-0a23273a2afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.313257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2accec1-d792-42d7-835d-54c33a0a7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.314660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2accec1-d792-42d7-835d-54c33a0a7ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.314932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2accec1-d792-42d7-835d-54c33a0a7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.315208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2accec1-d792-42d7-835d-54c33a0a7ece admin admin] PATH_INFO: `/v3/projects/3d1b6223025846c0ae5c69ff38e6f961/users/5c395665e2ae44c4931ae90d2ab631ed/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.344434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2accec1-d792-42d7-835d-54c33a0a7ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1b6223025846c0ae5c69ff38e6f961, user_id=5c395665e2ae44c4931ae90d2ab631ed, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.348043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2accec1-d792-42d7-835d-54c33a0a7ece admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:57.352758 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f96612d4-ded0-4be9-a520-0a23273a2afc None None] MFA Rules not processed for user `524880f2e8b24ce987a3b5d61bfd5652`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:57.354185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f96612d4-ded0-4be9-a520-0a23273a2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:57.381499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 806/1614] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:57 2022] PUT /identity/v3/projects/3d1b6223025846c0ae5c69ff38e6f961/users/5c395665e2ae44c4931ae90d2ab631ed/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:57.393599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.394400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.394878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.419842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:57.422165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:57.450071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 809/1615] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:57.451696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924347c6-97fd-43d7-a307-6104fc4234e7 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.452253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924347c6-97fd-43d7-a307-6104fc4234e7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.452693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924347c6-97fd-43d7-a307-6104fc4234e7 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.460497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 810/1616] 10.222.0.42 () {54 vars in 965 bytes} [Mon Sep 19 11:55:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:55:57.461791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924347c6-97fd-43d7-a307-6104fc4234e7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.486628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:57.505322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 807/1617] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:57.507068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.510496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:57.576016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924347c6-97fd-43d7-a307-6104fc4234e7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.589954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ee6f-0f42-428c-8f05-9006542489c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.591587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ee6f-0f42-428c-8f05-9006542489c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.592069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ee6f-0f42-428c-8f05-9006542489c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.592907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b073a3-3ba6-4738-b595-f8d3e9ad0a62 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.593314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ee6f-0f42-428c-8f05-9006542489c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.594959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863ee6f-0f42-428c-8f05-9006542489c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.596924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863ee6f-0f42-428c-8f05-9006542489c6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:57.597085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.597930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.598277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.598629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.613354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 811/1618] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:57.615091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e58e7-67fb-46ac-8cfa-d6fa76a93001 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.615378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e58e7-67fb-46ac-8cfa-d6fa76a93001 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.615655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e58e7-67fb-46ac-8cfa-d6fa76a93001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.618620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.620352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:57.631904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 808/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:57.634663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.644760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9e2df-4f29-4926-897c-18405a37637f service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.657307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.657963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-da3e58e7-67fb-46ac-8cfa-d6fa76a93001 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:57.658952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.659206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-da3e58e7-67fb-46ac-8cfa-d6fa76a93001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:57.659606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.660471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.662071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.670350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:57.735068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 812/1620] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:57.735068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27eaef-3370-43e5-82e8-00f98f68ad28 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.735068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27eaef-3370-43e5-82e8-00f98f68ad28 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.735068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27eaef-3370-43e5-82e8-00f98f68ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.736831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 809/1621] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:57.736831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.737541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5d27eaef-3370-43e5-82e8-00f98f68ad28 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:57.737541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5d27eaef-3370-43e5-82e8-00f98f68ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:57.749844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:57.834734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140ced6-013a-44b2-8c5b-f42b7cca1566 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.841824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.842732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.843230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.843569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.887002 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 813/1622] 10.222.0.42 () {58 vars in 1062 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:57.888849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d9abe-eeda-4986-8be8-7154d1cf5790 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.889669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d9abe-eeda-4986-8be8-7154d1cf5790 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.890175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d9abe-eeda-4986-8be8-7154d1cf5790 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.892167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 814/1623] 10.222.0.42 () {54 vars in 912 bytes} [Mon Sep 19 11:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:55:57.893131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d9abe-eeda-4986-8be8-7154d1cf5790 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.936092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.938163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:57.953847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 810/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:57.954876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:57.976373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec20a6e-90df-4a71-b2d3-83e251d883ce service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:57.989843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:57.990822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:57.991114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:57.991384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:57.993047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:57.995982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.008923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d9abe-eeda-4986-8be8-7154d1cf5790 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.014956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.015984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.016491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.017367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] PATH_INFO: `/v3/projects/b4e81fb49439497fac692d103978d2a7/users/a7d38e239f42488b984f3f466776c2eb/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.025658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 811/1625] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:55:57 2022] POST /identity/v3/users => generated 293 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:55:58.030258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.037220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e81fb49439497fac692d103978d2a7, user_id=a7d38e239f42488b984f3f466776c2eb, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.042225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.042451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa2e3d-a89c-4be1-aea5-49d114245621 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.046560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f0ef1-95ab-4aa9-9eb2-d82a32d67dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.048422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f0ef1-95ab-4aa9-9eb2-d82a32d67dff service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.048782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f0ef1-95ab-4aa9-9eb2-d82a32d67dff service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.049121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f0ef1-95ab-4aa9-9eb2-d82a32d67dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.056752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:58.063750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 815/1626] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:57 2022] PUT /identity/v3/projects/b4e81fb49439497fac692d103978d2a7/users/a7d38e239f42488b984f3f466776c2eb/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:58.064630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f0ef1-95ab-4aa9-9eb2-d82a32d67dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.065661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.066151 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f0ef1-95ab-4aa9-9eb2-d82a32d67dff service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.079939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 812/1627] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:58.082295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38263-f61a-48d6-a104-5ba4a7a082b6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.082653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38263-f61a-48d6-a104-5ba4a7a082b6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.082986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38263-f61a-48d6-a104-5ba4a7a082b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.118293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6ee38263-f61a-48d6-a104-5ba4a7a082b6 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:58.119890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6ee38263-f61a-48d6-a104-5ba4a7a082b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:58.200035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fd6b-04b9-42ba-a1e5-feced8a6cc87 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.214692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.216229 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.217546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.217848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.270692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 813/1628] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:55:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:58.278806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38263-f61a-48d6-a104-5ba4a7a082b6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.315917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:58.390244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.391892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.404935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 816/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:58.405861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.470581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38263-f61a-48d6-a104-5ba4a7a082b6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.485621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.487214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.487345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.487584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.488817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.488925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7000a6a-1a03-4a89-bd98-d8ee7b379cf7 service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.495286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.495831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.496082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.496554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.497004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.497867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.499660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.519192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 817/1630] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:58.520217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.528992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 814/1631] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:58.529881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.560644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97585977-11bc-4ed9-b54f-402e1d7cbac7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.573511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.576710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.577002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.577839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] PATH_INFO: `/v3/projects/b4e81fb49439497fac692d103978d2a7/users/a7d38e239f42488b984f3f466776c2eb/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.585717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e81fb49439497fac692d103978d2a7, user_id=a7d38e239f42488b984f3f466776c2eb, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.591417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.598805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc101b-f780-46b6-b3b0-a7e0456a5d5a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.603922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fd5ab-c141-4a14-891b-1b5259b1d0d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.605546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd5ab-c141-4a14-891b-1b5259b1d0d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.606009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd5ab-c141-4a14-891b-1b5259b1d0d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.606329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd5ab-c141-4a14-891b-1b5259b1d0d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.619754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fd5ab-c141-4a14-891b-1b5259b1d0d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.621251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fd5ab-c141-4a14-891b-1b5259b1d0d9 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.632143 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 815/1632] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:58 2022] PUT /identity/v3/projects/b4e81fb49439497fac692d103978d2a7/users/a7d38e239f42488b984f3f466776c2eb/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:58.633197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.633967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 818/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:58.635651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e56c-22c3-4f88-8374-be48db8dd67a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.636004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e56c-22c3-4f88-8374-be48db8dd67a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.636417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e56c-22c3-4f88-8374-be48db8dd67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.690719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1e52e56c-22c3-4f88-8374-be48db8dd67a None None] MFA Rules not processed for user `a7d38e239f42488b984f3f466776c2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:58.692455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1e52e56c-22c3-4f88-8374-be48db8dd67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:58.759264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbd17b-9877-46c4-9f94-edb10b0863c2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:58.770845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:58.772591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.774383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.774724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] PATH_INFO: `/v3/projects/39fcf82d133840499e8f518b3f3ee468/users/1d971d558e434046aee39352f28cedd3/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.811975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:58.819215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fcf82d133840499e8f518b3f3ee468, user_id=1d971d558e434046aee39352f28cedd3, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:58.821766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:58.825931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:58.840311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 819/1634] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:58 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:58.840311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48393687-8b08-4de3-b79d-757e330c9bce None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.840311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48393687-8b08-4de3-b79d-757e330c9bce None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.840311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48393687-8b08-4de3-b79d-757e330c9bce None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.853617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 820/1635] 10.222.0.42 () {54 vars in 912 bytes} [Mon Sep 19 11:55:58 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:55:58.855024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a4f2-23ba-481f-ba1b-855b58e10df1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:58.855309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a4f2-23ba-481f-ba1b-855b58e10df1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:58.855582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a4f2-23ba-481f-ba1b-855b58e10df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:58.862134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 816/1636] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:58 2022] PUT /identity/v3/projects/39fcf82d133840499e8f518b3f3ee468/users/1d971d558e434046aee39352f28cedd3/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:58.864565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:58.880128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-afc3a4f2-23ba-481f-ba1b-855b58e10df1 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:58.881611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-afc3a4f2-23ba-481f-ba1b-855b58e10df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:59.009350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4d7f-7374-4c85-9c43-d1410c968bbb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:59.014333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:59.015509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:59.015987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:59.016548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:59.062062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 821/1637] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:55:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:55:59.062932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3a4f2-23ba-481f-ba1b-855b58e10df1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:59.122213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:59.124727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:59.170715 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 817/1638] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:58 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:55:59.246653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3a4f2-23ba-481f-ba1b-855b58e10df1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:59.262518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:59.264675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:59.265285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:59.267722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:59.269367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:59.275063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:59.284839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:59.300274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 822/1639] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:55:59.300736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d8c58-844c-4e87-8cbd-bb19dff08153 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:59.308852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:55:59.311538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd7953-6b95-45d6-b0a3-46ef7a34c3d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:59.312286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7953-6b95-45d6-b0a3-46ef7a34c3d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:59.312630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7953-6b95-45d6-b0a3-46ef7a34c3d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:59.312908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7953-6b95-45d6-b0a3-46ef7a34c3d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:59.331352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312e23-1743-4c14-a1e4-fd803b3c9904 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:55:59.348384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd7953-6b95-45d6-b0a3-46ef7a34c3d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:59.348612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:55:59.348612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:59.348807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd7953-6b95-45d6-b0a3-46ef7a34c3d9 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:59.349600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:59.349881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] PATH_INFO: `/v3/projects/39fcf82d133840499e8f518b3f3ee468/users/1d971d558e434046aee39352f28cedd3/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:59.356323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fcf82d133840499e8f518b3f3ee468, user_id=1d971d558e434046aee39352f28cedd3, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:55:59.364852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:55:59.377225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 818/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:55:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:55:59.392644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 823/1641] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:55:59 2022] PUT /identity/v3/projects/39fcf82d133840499e8f518b3f3ee468/users/1d971d558e434046aee39352f28cedd3/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:55:59.405191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d7fc-08e0-412d-a4c0-6251945b925c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:55:59.405191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d7fc-08e0-412d-a4c0-6251945b925c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:55:59.405496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d7fc-08e0-412d-a4c0-6251945b925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:55:59.554516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5d26d7fc-08e0-412d-a4c0-6251945b925c None None] MFA Rules not processed for user `1d971d558e434046aee39352f28cedd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:55:59.563704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5d26d7fc-08e0-412d-a4c0-6251945b925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:55:59.820062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 819/1642] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:55:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:00.041489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:00.199008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5d9e1-c645-40c9-996d-a7b297c14b6a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:00.212615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:00.213976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:00.214279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:00.214521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:00.241893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:00.246704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:00.277496 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 824/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:00.683741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:00.684556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d7fc-08e0-412d-a4c0-6251945b925c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:00.714584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d7fc-08e0-412d-a4c0-6251945b925c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:00.723246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:00.728882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298e5f2-a1dc-4dac-bcde-2a6c75030c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:00.729539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298e5f2-a1dc-4dac-bcde-2a6c75030c5b service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:00.729817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298e5f2-a1dc-4dac-bcde-2a6c75030c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:00.730166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298e5f2-a1dc-4dac-bcde-2a6c75030c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:00.764387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:00.885769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cc809-5aae-487c-bc15-8c85c0180302 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:00.888519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298e5f2-a1dc-4dac-bcde-2a6c75030c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:00.890212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298e5f2-a1dc-4dac-bcde-2a6c75030c5b service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:00.891879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:00.892642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:00.892884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:00.917256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] PATH_INFO: `/v3/users/75e559b4614942bc99fee77672024d9e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:00.917256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e559b4614942bc99fee77672024d9e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:00.917256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: WARNING py.warnings [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:56:00.917256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: warnings.warn(msg) Sep 19 11:56:00.917256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: Sep 19 11:56:00.917256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:00.917766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 820/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:01.061207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e559b4614942bc99fee77672024d9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:01.137418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e559b4614942bc99fee77672024d9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:01.161228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e559b4614942bc99fee77672024d9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:01.162049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e559b4614942bc99fee77672024d9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:01.193218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e559b4614942bc99fee77672024d9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:01.214954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 825/1645] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:00 2022] DELETE /identity/v3/users/75e559b4614942bc99fee77672024d9e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:01.216427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:01.216817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:01.217098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:01.261526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:01.262813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:01.417271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 821/1646] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:01.460946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:01.465710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:01.672267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885526b-58e3-48f7-a101-04223d839861 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:01.680711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:01.681587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:01.681870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:01.682139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:01.723206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:01.729920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:01.745883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 826/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:03.768745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:03.770370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:03.788561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e6ba-f631-4758-af86-7a74b76e611a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:03.801053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:03.801752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:03.802029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:03.802305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] PATH_INFO: `/v3/projects/3917a61200334f50856af256944d3123` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:03.808379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3917a61200334f50856af256944d3123)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:03.814240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:03.814240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:03.826186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: WARNING py.warnings [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:56:03.826186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: warnings.warn(msg) Sep 19 11:56:03.826186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: Sep 19 11:56:03.827409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:03.836689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c28c8-a053-4be6-be6d-600065bcd3fa service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:03.855564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:03.856764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:03.859300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:03.859836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] PATH_INFO: `/v3/users/3b60e6b12ee9473ba844f752c21e7ea0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:03.863061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b60e6b12ee9473ba844f752c21e7ea0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:03.866482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:03.950965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:03.988502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3917a61200334f50856af256944d3123', 'request_id': 'req-b6b69a5e-7629-459e-8204-4e332ed456c0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:03.994442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b60e6b12ee9473ba844f752c21e7ea0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.004218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3917a61200334f50856af256944d3123', 'request_id': 'req-b6b69a5e-7629-459e-8204-4e332ed456c0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.020173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3917a61200334f50856af256944d3123', 'request_id': 'req-b6b69a5e-7629-459e-8204-4e332ed456c0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.031078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b60e6b12ee9473ba844f752c21e7ea0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.046982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] The token cache is being invalidate because project 3917a61200334f50856af256944d3123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:04.047359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.048626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.048884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b60e6b12ee9473ba844f752c21e7ea0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.049970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b60e6b12ee9473ba844f752c21e7ea0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.057798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 822/1648] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:03 2022] DELETE /identity/v3/projects/3917a61200334f50856af256944d3123 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:04.062161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4e23b4e6-7e6a-442a-9159-6a9bd84cea39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b60e6b12ee9473ba844f752c21e7ea0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.062328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:04.067905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:04.083617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 827/1649] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:03 2022] DELETE /identity/v3/users/3b60e6b12ee9473ba844f752c21e7ea0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:04.085097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:04.085429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:04.085706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:04.134380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:04.135600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:04.172950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:04.247112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 828/1650] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:04.252648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69a5e-7629-459e-8204-4e332ed456c0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:04.259761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:04.260733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:04.261299 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:04.261950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] PATH_INFO: `/v3/users/a7d38e239f42488b984f3f466776c2eb` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:04.264472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:04.266264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:04.272416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d38e239f42488b984f3f466776c2eb)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:04.277798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:04.404924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde508bd-a3d5-4169-a22b-34fe74c5a1da None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:04.416462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d38e239f42488b984f3f466776c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.423160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:04.424845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:04.425660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:04.426236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:04.430718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d38e239f42488b984f3f466776c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.431489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d38e239f42488b984f3f466776c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.440541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:04.442605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:04.457365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 829/1651] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:04.464741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d38e239f42488b984f3f466776c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.488412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d5ca96ac-65db-4bfc-a579-72194674b4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d38e239f42488b984f3f466776c2eb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:04.510589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 823/1652] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:04 2022] DELETE /identity/v3/users/a7d38e239f42488b984f3f466776c2eb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:04.981522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:04.984045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:05.006165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982c8d-d0e3-45e6-9e5b-97f0fb2053e2 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:05.112872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:05.147034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:05.148311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.150872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.151401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] PATH_INFO: `/v3/projects/d8108a0bbb5f4f5b83bfd0f49d696280` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.153200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8108a0bbb5f4f5b83bfd0f49d696280)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:05.156310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:05.226594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8108a0bbb5f4f5b83bfd0f49d696280', 'request_id': 'req-a599a756-8c03-4663-a81c-e2707da0b873'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:05.242219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8108a0bbb5f4f5b83bfd0f49d696280', 'request_id': 'req-a599a756-8c03-4663-a81c-e2707da0b873'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:05.251189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8108a0bbb5f4f5b83bfd0f49d696280', 'request_id': 'req-a599a756-8c03-4663-a81c-e2707da0b873'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:05.277018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] The token cache is being invalidate because project d8108a0bbb5f4f5b83bfd0f49d696280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:05.277426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:05.278310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a599a756-8c03-4663-a81c-e2707da0b873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:05.280885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 830/1653] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:04 2022] DELETE /identity/v3/projects/d8108a0bbb5f4f5b83bfd0f49d696280 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:05.286750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bc9f-1109-42d3-bf8d-b06c09fe9c46 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.287274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bc9f-1109-42d3-bf8d-b06c09fe9c46 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.287745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bc9f-1109-42d3-bf8d-b06c09fe9c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.345748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5f34bc9f-1109-42d3-bf8d-b06c09fe9c46 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:05.345748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5f34bc9f-1109-42d3-bf8d-b06c09fe9c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:05.463089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 824/1654] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:05.470665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370787a0-9320-4d7b-a13d-79ff543bdbc1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.471561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370787a0-9320-4d7b-a13d-79ff543bdbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.471917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370787a0-9320-4d7b-a13d-79ff543bdbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.504564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-370787a0-9320-4d7b-a13d-79ff543bdbc1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:05.505469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-370787a0-9320-4d7b-a13d-79ff543bdbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:05.519095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 831/1655] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:05.523349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bc9f-1109-42d3-bf8d-b06c09fe9c46 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:05.542785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bc9f-1109-42d3-bf8d-b06c09fe9c46 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:05.549042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:05.550185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.550705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.551395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.552414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:05.553082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:05.555658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:05.578046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 825/1656] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:05.582286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370787a0-9320-4d7b-a13d-79ff543bdbc1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:05.594393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370787a0-9320-4d7b-a13d-79ff543bdbc1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:05.600483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:05.602366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.603163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.603648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.604489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:05.609272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:05.662719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 832/1657] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:05 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:05.667671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:05.686426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5d998-3c36-4a6b-bd78-18ecce79f441 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:05.795787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:05.833070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:05.835386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.836001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.837319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.838809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:05.843051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:05.884078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 826/1658] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:05 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:05.888349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:05.902753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed6f-bdec-49d5-a84d-654de59588d8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:05.912798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:05.913824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.914546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.914997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.915984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:05.918837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:05.933088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 833/1659] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:05.938325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:05.952340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352f2ce-bdde-489b-aace-e0fe027af28f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:05.958533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ffd88-9d63-41a6-8503-142903c95aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:05.959818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ffd88-9d63-41a6-8503-142903c95aec admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:05.960232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ffd88-9d63-41a6-8503-142903c95aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:05.960649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ffd88-9d63-41a6-8503-142903c95aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:05.962832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ffd88-9d63-41a6-8503-142903c95aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:05.964665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ffd88-9d63-41a6-8503-142903c95aec admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:05.981185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 827/1660] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:05.985413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:06.000779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d82a5-6b5d-44fa-904f-296cd9c95127 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:06.007348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:06.008838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:06.009321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:06.009898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] PATH_INFO: `/v3/projects/f52350caac6d4bb29259f9b475422c8e/users/ed5696d76b0242e8b4d307d74d1a4278/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:06.037841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52350caac6d4bb29259f9b475422c8e, user_id=ed5696d76b0242e8b4d307d74d1a4278, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:06.043816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:06.086046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 834/1661] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:05 2022] PUT /identity/v3/projects/f52350caac6d4bb29259f9b475422c8e/users/ed5696d76b0242e8b4d307d74d1a4278/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:06.098649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd61502-b57a-4e7b-b733-56c4d974edd5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:06.099350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd61502-b57a-4e7b-b733-56c4d974edd5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:06.099870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd61502-b57a-4e7b-b733-56c4d974edd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:06.155303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cdd61502-b57a-4e7b-b733-56c4d974edd5 None None] MFA Rules not processed for user `ed5696d76b0242e8b4d307d74d1a4278`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:06.157497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cdd61502-b57a-4e7b-b733-56c4d974edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:06.309020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 828/1662] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:06.330424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:06.332946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:06.471133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de517cd1-18c4-4e4b-9932-702a20a052f4 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:06.483411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:06.484065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:06.484385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:06.484725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:06.506284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:06.507912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:06.549314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 835/1663] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:06.824236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721baa23-3348-491d-92e8-7de68d599175 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:06.824527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721baa23-3348-491d-92e8-7de68d599175 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:06.824803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721baa23-3348-491d-92e8-7de68d599175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:06.833904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:06.835270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:06.915636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:06.937608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-721baa23-3348-491d-92e8-7de68d599175 None None] MFA Rules not processed for user `9cba47a204da4d49b6e6313052f4c579`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:06.949293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-721baa23-3348-491d-92e8-7de68d599175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:07.135187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb949-05f0-41ea-847c-ada511226550 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:07.146973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:07.149566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.156917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.157390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] PATH_INFO: `/v3/projects/b4e81fb49439497fac692d103978d2a7` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:07.158898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e81fb49439497fac692d103978d2a7)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:07.165246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 829/1664] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:07.167583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.167881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.168156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:07.171099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:07.270439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] MFA Rules not processed for user `9cba47a204da4d49b6e6313052f4c579`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:07.271622 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:07.372333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:07.389836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e81fb49439497fac692d103978d2a7', 'request_id': 'req-0334578b-73b5-4b1a-b149-726ad95ea1fd'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.415700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e81fb49439497fac692d103978d2a7', 'request_id': 'req-0334578b-73b5-4b1a-b149-726ad95ea1fd'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.434876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e81fb49439497fac692d103978d2a7', 'request_id': 'req-0334578b-73b5-4b1a-b149-726ad95ea1fd'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.451657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 830/1665] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:07.458874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:07.462502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] The token cache is being invalidate because project b4e81fb49439497fac692d103978d2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:07.463290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.464277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0334578b-73b5-4b1a-b149-726ad95ea1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.464609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:07.471451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 836/1666] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:06 2022] DELETE /identity/v3/projects/b4e81fb49439497fac692d103978d2a7 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:07.476234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.477577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.478396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:07.528565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:07.530928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:07.691857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d00511-d6e3-4d14-a1f4-a00f9feab6c4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:07.708061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 837/1667] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:07.708196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05080c35-8572-4b90-bd67-7cec1adde156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:07.708798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05080c35-8572-4b90-bd67-7cec1adde156 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.709019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:07.709135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05080c35-8572-4b90-bd67-7cec1adde156 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.709350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05080c35-8572-4b90-bd67-7cec1adde156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:07.717668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:07.719289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-05080c35-8572-4b90-bd67-7cec1adde156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:07.738219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d834ba-35c2-40de-a12b-17819335df91 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:07.744939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05080c35-8572-4b90-bd67-7cec1adde156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:07.751005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05080c35-8572-4b90-bd67-7cec1adde156 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:07.753701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:07.754349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.754931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.754931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] PATH_INFO: `/v3/users/9520fd95910e462ea59184dd0dfb1bb2` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:07.756395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9520fd95910e462ea59184dd0dfb1bb2)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:07.759491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:07.789497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 831/1668] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:07.796915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0793-28f8-49cd-96c8-729b25478cca None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.797628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0793-28f8-49cd-96c8-729b25478cca None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.798065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0793-28f8-49cd-96c8-729b25478cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:07.855023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-673f0793-28f8-49cd-96c8-729b25478cca None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:07.856511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-673f0793-28f8-49cd-96c8-729b25478cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:07.874087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:07.877868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9520fd95910e462ea59184dd0dfb1bb2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.895917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 832/1669] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:07.899925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0793-28f8-49cd-96c8-729b25478cca None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:07.917044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9520fd95910e462ea59184dd0dfb1bb2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.928546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9520fd95910e462ea59184dd0dfb1bb2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.929281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9520fd95910e462ea59184dd0dfb1bb2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.933680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0793-28f8-49cd-96c8-729b25478cca None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:07.946455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2f7625b2-7591-430b-805d-a33a9cfcba0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9520fd95910e462ea59184dd0dfb1bb2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:07.955425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:07.957330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.961121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.961430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:07.970970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:07.974864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 838/1670] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:07 2022] DELETE /identity/v3/users/9520fd95910e462ea59184dd0dfb1bb2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:07.976013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:07.979748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dcb91-0b63-49b3-ac93-ea8ec987265e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:07.980043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dcb91-0b63-49b3-ac93-ea8ec987265e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:07.981844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:07.982938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dcb91-0b63-49b3-ac93-ea8ec987265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.056842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 833/1671] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:08.057854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:08.063909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:08.064509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-482dcb91-0b63-49b3-ac93-ea8ec987265e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:08.069683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-482dcb91-0b63-49b3-ac93-ea8ec987265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:08.098427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4e7f3-b5f9-48a6-9433-4a5990f5a003 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:08.240486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 839/1672] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:08.248231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:08.249017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:08.250366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:08.250366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.250366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:08.252128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:08.288092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 834/1673] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:08 2022] POST /identity/v3/projects => generated 357 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:08.293661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dcb91-0b63-49b3-ac93-ea8ec987265e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:08.311542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:08.313177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dcb91-0b63-49b3-ac93-ea8ec987265e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:08.315911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:08.429179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:08.470191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:08.471091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:08.471377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:08.471653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.472310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:08.473662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec79d85-d2a6-415f-a3cf-423a58a3a635 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:08.476188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:08.493688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:08.494296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:08.494759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:08.495714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.517066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:08.518972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:08.526628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 840/1674] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:08 2022] POST /identity/v3/users => generated 279 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:08.531196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:08.549224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 835/1675] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:08.549755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0eb3c-95d7-4e71-b665-9b1f5c814028 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:08.569388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:08.572234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:08.572514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:08.574045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.574756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:08.583691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:08.619931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 841/1676] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:08.623732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:08.667688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f3eb-73c9-4f8f-bf50-35fdd4185bbf service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:08.679616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddb14e-67d8-4a14-a475-ec46da5a919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:08.682965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddb14e-67d8-4a14-a475-ec46da5a919b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:08.683252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddb14e-67d8-4a14-a475-ec46da5a919b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:08.683535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddb14e-67d8-4a14-a475-ec46da5a919b admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.690823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddb14e-67d8-4a14-a475-ec46da5a919b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:08.692786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddb14e-67d8-4a14-a475-ec46da5a919b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:08.708888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 836/1677] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:08.713395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:08.725204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0c4-057f-48ad-847a-7a1da8110c02 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:08.766384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:08.767327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:08.767748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:08.768162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] PATH_INFO: `/v3/projects/71019ce853b5470cb94fc285761b4950/users/e70dc603e4ef4eaa88614f945fd7fde9/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.848650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71019ce853b5470cb94fc285761b4950, user_id=e70dc603e4ef4eaa88614f945fd7fde9, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:08.851385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:08.882283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 842/1678] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:08 2022] PUT /identity/v3/projects/71019ce853b5470cb94fc285761b4950/users/e70dc603e4ef4eaa88614f945fd7fde9/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:08.894399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc31c-e68f-406f-96c0-aa9eb49aa44b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:08.894689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc31c-e68f-406f-96c0-aa9eb49aa44b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:08.895193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc31c-e68f-406f-96c0-aa9eb49aa44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:08.962895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e52cc31c-e68f-406f-96c0-aa9eb49aa44b None None] MFA Rules not processed for user `e70dc603e4ef4eaa88614f945fd7fde9`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:08.969164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e52cc31c-e68f-406f-96c0-aa9eb49aa44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:09.172747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 837/1679] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:09.177103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:09.240070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:09.428295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8269e0-40f2-4cc7-9de1-97558fb84461 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:09.453826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a811722-3f33-4198-8b0c-244b9dadd9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:09.454467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811722-3f33-4198-8b0c-244b9dadd9cc admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:09.460130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811722-3f33-4198-8b0c-244b9dadd9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:09.460557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a811722-3f33-4198-8b0c-244b9dadd9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:09.461378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a811722-3f33-4198-8b0c-244b9dadd9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:09.464350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a811722-3f33-4198-8b0c-244b9dadd9cc admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:09.570282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 843/1680] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:09 2022] POST /identity/v3/projects => generated 355 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:09.571937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc31c-e68f-406f-96c0-aa9eb49aa44b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:09.597281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc31c-e68f-406f-96c0-aa9eb49aa44b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:09.597853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232a79-f22a-4345-953b-b8ffb44632e5 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:09.598245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232a79-f22a-4345-953b-b8ffb44632e5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:09.598646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232a79-f22a-4345-953b-b8ffb44632e5 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:09.600356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 844/1681] 10.222.0.42 () {54 vars in 912 bytes} [Mon Sep 19 11:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:56:09.606551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe81dd3-906c-4308-a422-8630cc70b214 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:09.606952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe81dd3-906c-4308-a422-8630cc70b214 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:09.607314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe81dd3-906c-4308-a422-8630cc70b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:09.728127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-afe81dd3-906c-4308-a422-8630cc70b214 None None] MFA Rules not processed for user `d84265ba2619438485db9a18f94c87aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:09.729581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-afe81dd3-906c-4308-a422-8630cc70b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:09.818559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:09.823445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:09.823828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:09.824112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:09.824815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:09.826825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:09.895188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 838/1682] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:09 2022] POST /identity/v3/users => generated 284 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:09.896858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:09.911286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 845/1683] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:56:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 19 11:56:09.935473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410d77-626a-4e6f-9d10-41041292a451 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:09.955685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:09.957854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:09.958359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:09.959392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:09.961345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:09.963394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:10.004852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe81dd3-906c-4308-a422-8630cc70b214 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:10.007557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 839/1684] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:10.035315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe81dd3-906c-4308-a422-8630cc70b214 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:10.047711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:10.048672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:10.049268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:10.049686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] PATH_INFO: `/v3/projects/1cb7bd9571534462b7c74ea0793a79b9/users/7e38e47537b94452a489758d46b85ccb/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:10.099642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb7bd9571534462b7c74ea0793a79b9, user_id=7e38e47537b94452a489758d46b85ccb, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:10.103637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:10.134626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 846/1685] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:10 2022] PUT /identity/v3/projects/1cb7bd9571534462b7c74ea0793a79b9/users/7e38e47537b94452a489758d46b85ccb/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:10.139892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:10.158145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17c49c-10d8-403f-b53c-26ae9459e680 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:10.275953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:10.346072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:10.362405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:10.364783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:10.365074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:10.365375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:10.366230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:10.372221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:10.390936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 840/1686] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:10.396321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:10.412600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01e91-8377-426b-bd3d-38cae5215ff9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:10.421924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf4797-851e-4ba3-948b-26c6999bf0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:10.422805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4797-851e-4ba3-948b-26c6999bf0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:10.423238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4797-851e-4ba3-948b-26c6999bf0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:10.423654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4797-851e-4ba3-948b-26c6999bf0a2 admin admin] PATH_INFO: `/v3/projects/1cb7bd9571534462b7c74ea0793a79b9/users/7e38e47537b94452a489758d46b85ccb/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:10.427811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf4797-851e-4ba3-948b-26c6999bf0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb7bd9571534462b7c74ea0793a79b9, user_id=7e38e47537b94452a489758d46b85ccb, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:10.432383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf4797-851e-4ba3-948b-26c6999bf0a2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:10.477716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 841/1687] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:10 2022] PUT /identity/v3/projects/1cb7bd9571534462b7c74ea0793a79b9/users/7e38e47537b94452a489758d46b85ccb/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:10.479623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:10.480084 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:10.480372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:10.549940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] MFA Rules not processed for user `7e38e47537b94452a489758d46b85ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:10.551813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:10.563015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb593-6440-442d-87cb-b6d2b9cec9ae admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:10.676925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:10.740333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 842/1688] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:10.741625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:10.742409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:10.751712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:10.752228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:10.753122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:10.755787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:10.784329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:10.786092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:10.811493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 847/1689] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:10.929104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a23ce0-2568-4e46-ae2b-4e548ae45fe8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:10.935454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:10.936962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:10.938073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:10.938494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:10.951345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:10.953140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:10.976051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 843/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:11.046749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:11.048493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:11.228922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095721e7-5ac8-4bc2-8264-d4249b208665 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:11.237909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:11.239009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:11.239506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:11.239987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] PATH_INFO: `/v3/projects/60bc964331f849ea8322b96493b72f23` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:11.241862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bc964331f849ea8322b96493b72f23)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:11.244679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:11.259771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:11.271116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745e960-9710-4f81-81bd-4ec3024b26d2 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:11.285596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1178cc-b612-41db-baa5-edfdb86cd056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:11.286230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1178cc-b612-41db-baa5-edfdb86cd056 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:11.286693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1178cc-b612-41db-baa5-edfdb86cd056 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:11.286974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1178cc-b612-41db-baa5-edfdb86cd056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:11.357486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bc964331f849ea8322b96493b72f23', 'request_id': 'req-175f9242-56b2-487a-bf24-d74dd1a4d6ae'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:11.368765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bc964331f849ea8322b96493b72f23', 'request_id': 'req-175f9242-56b2-487a-bf24-d74dd1a4d6ae'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:11.384636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bc964331f849ea8322b96493b72f23', 'request_id': 'req-175f9242-56b2-487a-bf24-d74dd1a4d6ae'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:11.418569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] The token cache is being invalidate because project 60bc964331f849ea8322b96493b72f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:11.418867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:11.420328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-175f9242-56b2-487a-bf24-d74dd1a4d6ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:11.427765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 848/1691] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:11 2022] DELETE /identity/v3/projects/60bc964331f849ea8322b96493b72f23 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:11.436905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0c71f-15de-4546-9080-4d1f4f0b9b5c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:11.437215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0c71f-15de-4546-9080-4d1f4f0b9b5c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:11.437498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0c71f-15de-4546-9080-4d1f4f0b9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:11.444802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:11.478769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1178cc-b612-41db-baa5-edfdb86cd056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:11.479703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1178cc-b612-41db-baa5-edfdb86cd056 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:11.519246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 844/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:11.567367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-52a0c71f-15de-4546-9080-4d1f4f0b9b5c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:11.569967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-52a0c71f-15de-4546-9080-4d1f4f0b9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:11.850465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 849/1693] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:11.852748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e22ec-b0fb-4c4b-bafa-5cfde454eb82 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:11.853702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e22ec-b0fb-4c4b-bafa-5cfde454eb82 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:11.854156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e22ec-b0fb-4c4b-bafa-5cfde454eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:11.903873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fb4e22ec-b0fb-4c4b-bafa-5cfde454eb82 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:11.905350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fb4e22ec-b0fb-4c4b-bafa-5cfde454eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:11.945762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 845/1694] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:11.950507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0c71f-15de-4546-9080-4d1f4f0b9b5c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:11.966814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:11.966814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0c71f-15de-4546-9080-4d1f4f0b9b5c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:11.979404 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:11.980026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:11.980301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:11.980572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:11.981266 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:11.981563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:11.983411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:12.026144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 850/1695] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:12.029409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e22ec-b0fb-4c4b-bafa-5cfde454eb82 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:12.053206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e22ec-b0fb-4c4b-bafa-5cfde454eb82 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:12.069859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:12.073256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:12.073592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:12.073871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:12.074551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:12.079155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:12.140927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 846/1696] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:12 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:12.145477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:12.161740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea7faa-60ab-49bd-a871-50d56ec1ec8d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:12.321686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:12.322320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:12.322601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:12.322872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:12.323583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:12.325827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:12.368971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 851/1697] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:12 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:12.372717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:12.386512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5c78-1388-4827-9333-1a9c1b73ad83 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:12.403324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:12.404155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:12.404436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:12.404777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:12.405473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:12.407099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:12.440709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 847/1698] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:12.443035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:12.458685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c2a60-94b4-45b0-8ebc-82eb133097b8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:12.471685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:12.472390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:12.472579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:12.472854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:12.473539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:12.482584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:12.511575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 852/1699] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:12.515757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:12.532499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7debc-1eb6-4ecb-9da8-e097ef28d74d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:12.537974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:12.544671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:12.549827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfb789-1d8d-42df-9e91-59e8665265bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:12.550510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb789-1d8d-42df-9e91-59e8665265bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:12.550789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb789-1d8d-42df-9e91-59e8665265bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:12.551065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb789-1d8d-42df-9e91-59e8665265bc admin admin] PATH_INFO: `/v3/projects/6cb0329e0b994455985fb96a836b2cf2/users/7c42ad2edfef4515a527675670f5e075/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:12.611764 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfb789-1d8d-42df-9e91-59e8665265bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb0329e0b994455985fb96a836b2cf2, user_id=7c42ad2edfef4515a527675670f5e075, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:12.620632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfb789-1d8d-42df-9e91-59e8665265bc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:12.662531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 848/1700] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:12 2022] PUT /identity/v3/projects/6cb0329e0b994455985fb96a836b2cf2/users/7c42ad2edfef4515a527675670f5e075/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:12.686990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9eb2c-0498-4143-b1a5-03bec62eb574 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:12.689575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9eb2c-0498-4143-b1a5-03bec62eb574 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:12.693316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9eb2c-0498-4143-b1a5-03bec62eb574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:12.810091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8ad9eb2c-0498-4143-b1a5-03bec62eb574 None None] MFA Rules not processed for user `7c42ad2edfef4515a527675670f5e075`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:12.811814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8ad9eb2c-0498-4143-b1a5-03bec62eb574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:12.859525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274e529-d8b1-4ae4-aa2a-93448160c5c5 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:13.024723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 849/1701] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:13.026353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d17bdc-a157-4071-a491-c5e9c2b7b393 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:13.026734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d17bdc-a157-4071-a491-c5e9c2b7b393 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:13.027242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d17bdc-a157-4071-a491-c5e9c2b7b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:13.050308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-46d17bdc-a157-4071-a491-c5e9c2b7b393 None None] MFA Rules not processed for user `9cba47a204da4d49b6e6313052f4c579`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:13.052160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-46d17bdc-a157-4071-a491-c5e9c2b7b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:13.147882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:13.149047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:13.149518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:13.149641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:13.157372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:13.177497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 850/1702] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:13.179785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6dec8-7a3a-4aa2-8e19-e9942a071090 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:13.180458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6dec8-7a3a-4aa2-8e19-e9942a071090 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:13.189189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:13.190829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:13.204427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6dec8-7a3a-4aa2-8e19-e9942a071090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:13.234719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 853/1703] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:13.237118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:13.257060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:13.328925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ade6dec8-7a3a-4aa2-8e19-e9942a071090 None None] MFA Rules not processed for user `092e7d9f6d0f4c6984785e05162483ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:13.345794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ade6dec8-7a3a-4aa2-8e19-e9942a071090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:13.400850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:13.563152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc44c4-ccd7-4a98-bf33-8bd80fd89298 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:13.586387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64231e7-8ba2-41ab-b5d2-d7bbaeba0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:13.588116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64231e7-8ba2-41ab-b5d2-d7bbaeba0e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:13.598301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64231e7-8ba2-41ab-b5d2-d7bbaeba0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:13.598754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64231e7-8ba2-41ab-b5d2-d7bbaeba0e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:13.599359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64231e7-8ba2-41ab-b5d2-d7bbaeba0e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:13.603263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64231e7-8ba2-41ab-b5d2-d7bbaeba0e37 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:13.729405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 854/1704] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:13 2022] POST /identity/v3/projects => generated 385 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:13.734605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c380e9-df01-4acb-b20f-c48467b9f17c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:13.737587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c380e9-df01-4acb-b20f-c48467b9f17c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:13.738092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c380e9-df01-4acb-b20f-c48467b9f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:13.788623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 851/1705] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 610 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:13.788623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6dec8-7a3a-4aa2-8e19-e9942a071090 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:13.841252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6dec8-7a3a-4aa2-8e19-e9942a071090 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:13.896050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b3c380e9-df01-4acb-b20f-c48467b9f17c None None] MFA Rules not processed for user `25dc03c038c8440aa9a0dbbd77b4a6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:13.897343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b3c380e9-df01-4acb-b20f-c48467b9f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:14.059882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:14.061426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:14.063380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:14.063916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:14.078468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:14.085512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:14.122154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 852/1706] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:13 2022] POST /identity/v3/users => generated 299 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:14.123489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:14.127799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:14.228456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 855/1707] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:14.230725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c380e9-df01-4acb-b20f-c48467b9f17c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:14.278196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c380e9-df01-4acb-b20f-c48467b9f17c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:14.292548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fc79-ca86-478a-ac42-b3a32774fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:14.293463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fc79-ca86-478a-ac42-b3a32774fdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:14.293639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fc79-ca86-478a-ac42-b3a32774fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:14.294019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fc79-ca86-478a-ac42-b3a32774fdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:14.294783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fc79-ca86-478a-ac42-b3a32774fdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:14.307152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fc79-ca86-478a-ac42-b3a32774fdb9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:14.345282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 856/1708] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:14.347813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fdac4-26e3-4a5d-a30e-1d2910a2b8c9 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:14.347813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fdac4-26e3-4a5d-a30e-1d2910a2b8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:14.347813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fdac4-26e3-4a5d-a30e-1d2910a2b8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:14.365923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d470c57-3061-4d4d-a373-7bc9ea8032a3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:14.391070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1a3fdac4-26e3-4a5d-a30e-1d2910a2b8c9 None None] MFA Rules not processed for user `25dc03c038c8440aa9a0dbbd77b4a6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:14.391306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:14.391943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:14.392286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:14.392629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:14.394618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1a3fdac4-26e3-4a5d-a30e-1d2910a2b8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:14.422457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 857/1709] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:14.423381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fdac4-26e3-4a5d-a30e-1d2910a2b8c9 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:14.450321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fdac4-26e3-4a5d-a30e-1d2910a2b8c9 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:14.490270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:14.490964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:14.491246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:14.491530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] PATH_INFO: `/v3/projects/ff79437b64db4ce3bee38dce3df4184a/users/3742d7a79c26442fbc019db2c41533fb/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:14.518752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:14.563667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff79437b64db4ce3bee38dce3df4184a, user_id=3742d7a79c26442fbc019db2c41533fb, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:14.579060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:14.626955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:14.635442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:14.661761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 858/1710] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:14 2022] PUT /identity/v3/projects/ff79437b64db4ce3bee38dce3df4184a/users/3742d7a79c26442fbc019db2c41533fb/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:14.666905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:14.672593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 853/1711] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:14.829335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:14.891683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a57707-2cf5-468c-9b18-94f175e39847 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:14.912314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18a604-2a8b-4fd2-ac7d-dfffbdb10d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:14.912958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18a604-2a8b-4fd2-ac7d-dfffbdb10d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:14.913295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18a604-2a8b-4fd2-ac7d-dfffbdb10d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:14.913586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18a604-2a8b-4fd2-ac7d-dfffbdb10d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:14.915047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18a604-2a8b-4fd2-ac7d-dfffbdb10d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:14.916817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18a604-2a8b-4fd2-ac7d-dfffbdb10d1a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:14.948509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:14.948808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 859/1712] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:15.027061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e9da-b960-48cc-84e6-3529e599a4be service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:15.061532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:15.064503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:15.068123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:15.069589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] PATH_INFO: `/v3/projects/ff79437b64db4ce3bee38dce3df4184a/users/3742d7a79c26442fbc019db2c41533fb/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:15.079295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff79437b64db4ce3bee38dce3df4184a, user_id=3742d7a79c26442fbc019db2c41533fb, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:15.102482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:15.187671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 854/1713] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:14 2022] PUT /identity/v3/projects/ff79437b64db4ce3bee38dce3df4184a/users/3742d7a79c26442fbc019db2c41533fb/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:15.206904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:15.208534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:15.208636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:15.211687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:15.217716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:15.383714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] MFA Rules not processed for user `3742d7a79c26442fbc019db2c41533fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:15.390200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:15.463325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324655c2-fd04-4952-b1c7-c5e4f4e1b106 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:15.479988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad200-37d2-453a-b860-467c1c2c4749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:15.482177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad200-37d2-453a-b860-467c1c2c4749 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:15.483369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad200-37d2-453a-b860-467c1c2c4749 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:15.484592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad200-37d2-453a-b860-467c1c2c4749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:15.753132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 860/1714] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:15.755813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad200-37d2-453a-b860-467c1c2c4749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:15.771912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:15.773282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad200-37d2-453a-b860-467c1c2c4749 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:15.774270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:15.805614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 855/1715] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:15.901589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989849-d3fa-45db-b093-396ba367a784 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:15.916775 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989849-d3fa-45db-b093-396ba367a784 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:15.921982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989849-d3fa-45db-b093-396ba367a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:15.970354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84153fa6-0179-43dd-aa31-2beea73ea61f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:15.985406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:15.986214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:15.986579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:15.986861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:16.010048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:16.011519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:16.039709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 861/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:16.092715 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-83989849-d3fa-45db-b093-396ba367a784 None None] MFA Rules not processed for user `5c395665e2ae44c4931ae90d2ab631ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:16.102939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-83989849-d3fa-45db-b093-396ba367a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:16.176369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:16.255325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:16.335756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda543-50cf-4daa-aadc-d05687aa6171 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:16.350326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 856/1717] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:16.359133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:16.359881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:16.360172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:16.360453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] PATH_INFO: `/v3/users/7c42ad2edfef4515a527675670f5e075` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:16.361728 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c42ad2edfef4515a527675670f5e075)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:16.363717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:16.365566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:16.435317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83989849-d3fa-45db-b093-396ba367a784 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:16.455973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83989849-d3fa-45db-b093-396ba367a784 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:16.475591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a12af-e74b-4865-a3c4-aa038441ec96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:16.476424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a12af-e74b-4865-a3c4-aa038441ec96 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:16.478069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a12af-e74b-4865-a3c4-aa038441ec96 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:16.478069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a12af-e74b-4865-a3c4-aa038441ec96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:16.506999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a12af-e74b-4865-a3c4-aa038441ec96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:16.513391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a12af-e74b-4865-a3c4-aa038441ec96 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:16.518842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c42ad2edfef4515a527675670f5e075'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:16.567163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 857/1718] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:16.593460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c42ad2edfef4515a527675670f5e075'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:16.616052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c42ad2edfef4515a527675670f5e075'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:16.617738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c42ad2edfef4515a527675670f5e075'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:16.672921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c42ad2edfef4515a527675670f5e075'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:16.691650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 862/1719] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:16 2022] DELETE /identity/v3/users/7c42ad2edfef4515a527675670f5e075 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:16.694379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8296a-d22f-40d5-a1b2-9fae8cc00367 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:16.694667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8296a-d22f-40d5-a1b2-9fae8cc00367 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:16.694942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8296a-d22f-40d5-a1b2-9fae8cc00367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:16.784999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b5b8296a-d22f-40d5-a1b2-9fae8cc00367 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:16.787184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b5b8296a-d22f-40d5-a1b2-9fae8cc00367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:17.064351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 858/1720] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:17.192608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:17.196587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:17.478479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3635c-4fbd-472b-98d0-c22147fadd44 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:17.503483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:17.504316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:17.504776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:17.505250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:17.552161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:17.556977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:17.597102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 863/1721] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:18.808381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:18.808938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:18.808938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:19.035309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:19.046793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:19.196249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 859/1722] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:19.506971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:19.509370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:19.710019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:19.719148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c696c-e8da-47aa-8320-4723ca0d8a79 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:19.737907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:19.738810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:19.739244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:19.739666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:19.757200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:19.759427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:19.782373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 864/1723] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:56:20.267521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:20.269846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:20.300122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2ce81-f205-4a66-9a23-725d3baea599 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:20.309115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:20.310746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:20.311374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:20.312590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] PATH_INFO: `/v3/projects/6cb0329e0b994455985fb96a836b2cf2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:20.314059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb0329e0b994455985fb96a836b2cf2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:20.327234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:20.550863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:20.624144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb0329e0b994455985fb96a836b2cf2', 'request_id': 'req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:20.681391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb0329e0b994455985fb96a836b2cf2', 'request_id': 'req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:20.705426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb0329e0b994455985fb96a836b2cf2', 'request_id': 'req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:20.740178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] The token cache is being invalidate because project 6cb0329e0b994455985fb96a836b2cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:20.741654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:20.744109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:20.754498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:20.754952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 860/1724] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:20 2022] DELETE /identity/v3/projects/6cb0329e0b994455985fb96a836b2cf2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:20.775177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8366ff3-c0da-4948-ba91-0d5ec259f6bd service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:20.974876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:20.977636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:20.978301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:20.979186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] PATH_INFO: `/v3/users/3742d7a79c26442fbc019db2c41533fb` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:20.981716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3742d7a79c26442fbc019db2c41533fb)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:20.984203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:21.129513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3742d7a79c26442fbc019db2c41533fb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.170510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3742d7a79c26442fbc019db2c41533fb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.181057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3742d7a79c26442fbc019db2c41533fb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.181762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3742d7a79c26442fbc019db2c41533fb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.241234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-97b20173-5703-488a-be2f-7c2c10b8936f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3742d7a79c26442fbc019db2c41533fb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.286737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 865/1725] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:20 2022] DELETE /identity/v3/users/3742d7a79c26442fbc019db2c41533fb => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:21.526793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:21.528564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:21.558116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbd60-9c5f-4336-bf83-3c19c7d7e3dc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:21.775746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:21.777582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:21.777864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:21.778136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] PATH_INFO: `/v3/users/ed5696d76b0242e8b4d307d74d1a4278` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:21.783428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5696d76b0242e8b4d307d74d1a4278)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:21.786384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:21.907393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5696d76b0242e8b4d307d74d1a4278'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.922842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5696d76b0242e8b4d307d74d1a4278'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.923678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5696d76b0242e8b4d307d74d1a4278'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:21.979131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5696d76b0242e8b4d307d74d1a4278'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:22.013065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5696d76b0242e8b4d307d74d1a4278'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:22.052319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 861/1726] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:21 2022] DELETE /identity/v3/users/ed5696d76b0242e8b4d307d74d1a4278 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:22.057842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26397d-f362-407b-b183-67e72e08a652 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:22.058403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26397d-f362-407b-b183-67e72e08a652 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:22.058483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26397d-f362-407b-b183-67e72e08a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:22.117488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fd26397d-f362-407b-b183-67e72e08a652 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:22.125549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd26397d-f362-407b-b183-67e72e08a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:22.286469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 866/1727] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:22.583558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:22.585034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:22.756831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:22.773907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dc628-ab3e-4ef3-9411-30f336427dce admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:22.786933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96477-024d-4191-aa9a-a2e412db50ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:22.787626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96477-024d-4191-aa9a-a2e412db50ed service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:22.788038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96477-024d-4191-aa9a-a2e412db50ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:22.788356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96477-024d-4191-aa9a-a2e412db50ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:22.827217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96477-024d-4191-aa9a-a2e412db50ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:22.832952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96477-024d-4191-aa9a-a2e412db50ed service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:22.843951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:22.844307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:22.844588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:22.896454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 862/1728] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:22.905985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] MFA Rules not processed for user `092e7d9f6d0f4c6984785e05162483ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:22.910725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:22.928609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:23.119848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 867/1729] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:23.314135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:23.314709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:23.315374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:23.373521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] MFA Rules not processed for user `d84265ba2619438485db9a18f94c87aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:23.378635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:23.398779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 863/1730] 10.222.0.95 () {58 vars in 1015 bytes} [Mon Sep 19 11:56:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:23.737843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:23.740292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:23.752812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:23.754609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:23.793004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c6603-d74c-4f5f-a62d-4bff366a2438 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:23.794319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca3f2a-c8c3-49bd-be7e-81e4c732378d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:23.805594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcdf07-fb32-44ef-b77c-dc142a3065cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:23.807143 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcdf07-fb32-44ef-b77c-dc142a3065cc service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:23.807604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcdf07-fb32-44ef-b77c-dc142a3065cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:23.808347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:23.808656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcdf07-fb32-44ef-b77c-dc142a3065cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:23.810374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:23.811395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:23.812028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] PATH_INFO: `/v3/projects/ff79437b64db4ce3bee38dce3df4184a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:23.815606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff79437b64db4ce3bee38dce3df4184a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:23.824337 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:23.831568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcdf07-fb32-44ef-b77c-dc142a3065cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:23.833658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcdf07-fb32-44ef-b77c-dc142a3065cc service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:23.852273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 864/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:23.964419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff79437b64db4ce3bee38dce3df4184a', 'request_id': 'req-91ee03f8-4cde-41cf-8823-c817a5047034'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:23.983748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff79437b64db4ce3bee38dce3df4184a', 'request_id': 'req-91ee03f8-4cde-41cf-8823-c817a5047034'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:23.998748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff79437b64db4ce3bee38dce3df4184a', 'request_id': 'req-91ee03f8-4cde-41cf-8823-c817a5047034'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:24.033625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] The token cache is being invalidate because project ff79437b64db4ce3bee38dce3df4184a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:24.034686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:24.037876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91ee03f8-4cde-41cf-8823-c817a5047034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:24.045881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 868/1732] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:23 2022] DELETE /identity/v3/projects/ff79437b64db4ce3bee38dce3df4184a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:24.047518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b19a-873c-46b6-9c2b-80ffd259e9d6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:24.048115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b19a-873c-46b6-9c2b-80ffd259e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:24.048591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b19a-873c-46b6-9c2b-80ffd259e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:24.107516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6935b19a-873c-46b6-9c2b-80ffd259e9d6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:24.109341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6935b19a-873c-46b6-9c2b-80ffd259e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:24.262473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 865/1733] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:24.271647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258a8c1-f975-40ea-9988-3b58a5eb7fa6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:24.272185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258a8c1-f975-40ea-9988-3b58a5eb7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:24.272185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258a8c1-f975-40ea-9988-3b58a5eb7fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:24.350457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6258a8c1-f975-40ea-9988-3b58a5eb7fa6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:24.362265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6258a8c1-f975-40ea-9988-3b58a5eb7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:24.407246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 869/1734] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:24.409511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b19a-873c-46b6-9c2b-80ffd259e9d6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:24.423214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b19a-873c-46b6-9c2b-80ffd259e9d6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:24.440379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:24.441739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:24.442627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:24.443174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:24.447362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:24.450406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:24.454136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:24.503809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 866/1735] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:24.506524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258a8c1-f975-40ea-9988-3b58a5eb7fa6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:24.530918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258a8c1-f975-40ea-9988-3b58a5eb7fa6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:24.544041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:24.545305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:24.545949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:24.546369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:24.547036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:24.553213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:24.638054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:24.643737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 870/1736] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:24 2022] POST /identity/v3/projects => generated 401 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:24.664230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c80cd-b208-4752-aba4-c9eadbbcd21c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:24.896907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:24.898359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:24.900346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:24.900813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:24.901703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:24.903825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:24.970763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 867/1737] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:24 2022] POST /identity/v3/users => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:24.971738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:24.989128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17624e9-04c2-4792-89a4-725854952921 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:25.013365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:25.014093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:25.014400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:25.014774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:25.015440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:25.017706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:25.036299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 871/1738] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:25.037869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:25.058122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d260518-26b2-4085-8147-af3b928b8949 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:25.084421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:25.089693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:25.095944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:25.098486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:25.099391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:25.102720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:25.156199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 868/1739] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:25.160972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:25.178935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da722-83ca-4599-9bf6-debe9a2caa10 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:25.192837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d070bd9-44b7-4385-a3ab-9ee5b7a10283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:25.193631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070bd9-44b7-4385-a3ab-9ee5b7a10283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:25.193913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070bd9-44b7-4385-a3ab-9ee5b7a10283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:25.194190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070bd9-44b7-4385-a3ab-9ee5b7a10283 admin admin] PATH_INFO: `/v3/projects/c4bd712b7d6d4938a6ca0e7e695356c8/users/bf170b1b74cf42eca61917ef22b1c629/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:25.232633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d070bd9-44b7-4385-a3ab-9ee5b7a10283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bd712b7d6d4938a6ca0e7e695356c8, user_id=bf170b1b74cf42eca61917ef22b1c629, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:25.238261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d070bd9-44b7-4385-a3ab-9ee5b7a10283 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:25.257992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:25.261106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:25.276605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 872/1740] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:25 2022] PUT /identity/v3/projects/c4bd712b7d6d4938a6ca0e7e695356c8/users/bf170b1b74cf42eca61917ef22b1c629/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:25.288280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846c580-8d72-45c6-a32a-345b60c0b9b7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:25.288556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846c580-8d72-45c6-a32a-345b60c0b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:25.289324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846c580-8d72-45c6-a32a-345b60c0b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:25.306980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27467f84-4cab-4738-8ba3-6191fc5af888 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:25.417310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6846c580-8d72-45c6-a32a-345b60c0b9b7 None None] MFA Rules not processed for user `bf170b1b74cf42eca61917ef22b1c629`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:25.422495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6846c580-8d72-45c6-a32a-345b60c0b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:25.463684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:25.533390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:25.539186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:25.540145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:25.540537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:25.540917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] PATH_INFO: `/v3/projects/f52350caac6d4bb29259f9b475422c8e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:25.542710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52350caac6d4bb29259f9b475422c8e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:25.551323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:25.705108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 873/1741] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:25 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:25.712800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d2d2-bd28-4c38-943b-7b2c5ffc45df None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:25.725048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d2d2-bd28-4c38-943b-7b2c5ffc45df None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:25.725653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d2d2-bd28-4c38-943b-7b2c5ffc45df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:25.733886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52350caac6d4bb29259f9b475422c8e', 'request_id': 'req-ca561cf5-80a8-48f4-8326-45ad88426516'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:25.758873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52350caac6d4bb29259f9b475422c8e', 'request_id': 'req-ca561cf5-80a8-48f4-8326-45ad88426516'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:25.780965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52350caac6d4bb29259f9b475422c8e', 'request_id': 'req-ca561cf5-80a8-48f4-8326-45ad88426516'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:25.830494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e577d2d2-bd28-4c38-943b-7b2c5ffc45df None None] MFA Rules not processed for user `5c395665e2ae44c4931ae90d2ab631ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:25.838405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e577d2d2-bd28-4c38-943b-7b2c5ffc45df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:25.859805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] The token cache is being invalidate because project f52350caac6d4bb29259f9b475422c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:25.865073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:25.866035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:25.881001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 869/1742] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:25 2022] DELETE /identity/v3/projects/f52350caac6d4bb29259f9b475422c8e => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:25.881001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:25.881702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:26.129362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 874/1743] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:26.131163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7307b9-ae26-457f-a70e-2b22581fbb01 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.134079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7307b9-ae26-457f-a70e-2b22581fbb01 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.134590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7307b9-ae26-457f-a70e-2b22581fbb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.142046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca561cf5-80a8-48f4-8326-45ad88426516 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:26.153479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:26.155093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.156213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.157969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.158768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:26.160842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:26.203206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ba7307b9-ae26-457f-a70e-2b22581fbb01 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:26.211071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ba7307b9-ae26-457f-a70e-2b22581fbb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:26.254876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 875/1744] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:26.259924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14951c-67a9-4865-90fd-842c2379f2b7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.263433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14951c-67a9-4865-90fd-842c2379f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.265507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14951c-67a9-4865-90fd-842c2379f2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.270657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 870/1745] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:25 2022] POST /identity/v3/projects => generated 401 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:26.276644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:26.355565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4f14951c-67a9-4865-90fd-842c2379f2b7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:26.358364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4f14951c-67a9-4865-90fd-842c2379f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:26.496442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:26.546369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 876/1746] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:26.547620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14951c-67a9-4865-90fd-842c2379f2b7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:26.551877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d7ab4-cd95-4ff0-896b-d95917c4dfbb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:26.566433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e8f1c-c771-439f-9900-b95672f964b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:26.567287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8f1c-c771-439f-9900-b95672f964b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.568800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8f1c-c771-439f-9900-b95672f964b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.570681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8f1c-c771-439f-9900-b95672f964b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.572122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14951c-67a9-4865-90fd-842c2379f2b7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:26.573011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8f1c-c771-439f-9900-b95672f964b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:26.577942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8f1c-c771-439f-9900-b95672f964b8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:26.584285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bba031-06a2-4bdb-8625-c1414ec82b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:26.584959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba031-06a2-4bdb-8625-c1414ec82b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.585910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba031-06a2-4bdb-8625-c1414ec82b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.586376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba031-06a2-4bdb-8625-c1414ec82b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.595413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bba031-06a2-4bdb-8625-c1414ec82b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:26.595413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bba031-06a2-4bdb-8625-c1414ec82b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:26.596408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bba031-06a2-4bdb-8625-c1414ec82b5f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:26.655910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 877/1747] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:26.659393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d757c-bd7e-4bdf-ba48-1c0171a62e0e None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.659858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d757c-bd7e-4bdf-ba48-1c0171a62e0e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.660272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d757c-bd7e-4bdf-ba48-1c0171a62e0e None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.662419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 878/1748] 10.222.0.42 () {54 vars in 912 bytes} [Mon Sep 19 11:56:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:56:26.665964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d757c-bd7e-4bdf-ba48-1c0171a62e0e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:26.692731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 871/1749] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:26 2022] POST /identity/v3/users => generated 307 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:26.696682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d757c-bd7e-4bdf-ba48-1c0171a62e0e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:26.701836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:26.702703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.703132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.703475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.703826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4ceb-cf03-4af1-8170-01adc760ad52 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:26.704705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:26.705224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4ceb-cf03-4af1-8170-01adc760ad52 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:26.705524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4ceb-cf03-4af1-8170-01adc760ad52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:26.706963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:26.784261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-340e4ceb-cf03-4af1-8170-01adc760ad52 None None] MFA Rules not processed for user `d84265ba2619438485db9a18f94c87aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:26.785741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-340e4ceb-cf03-4af1-8170-01adc760ad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:26.880891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 879/1750] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:26 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:26.885739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:26.886730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 872/1751] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:26.887774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4ceb-cf03-4af1-8170-01adc760ad52 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:26.974394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4ceb-cf03-4af1-8170-01adc760ad52 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:27.127430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:27.323796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b3ae3-e2f2-419a-ae24-54b3e46d2e5d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:27.334651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:27.335292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:27.336112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:27.336385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:27.337564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:27.338178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:27.338460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:27.338726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:27.343355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:27.345133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:27.347770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:27.352733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:27.408072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 880/1752] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:27.416094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:27.431609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:27.453603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 873/1753] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:26 2022] POST /identity/v3/users => generated 289 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:27.454527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:27.483872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d794b99-4c28-46c7-889a-d37a92a3d75d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:27.502256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:27.502959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:27.503275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:27.503581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] PATH_INFO: `/v3/projects/aa7c4e421e5e415ea82c437ca2f41209/users/6bdd02ab3fac4ce898a7d6c13dddbda7/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:27.572310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7c4e421e5e415ea82c437ca2f41209, user_id=6bdd02ab3fac4ce898a7d6c13dddbda7, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:27.587986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:27.648397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 874/1754] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:27 2022] PUT /identity/v3/projects/aa7c4e421e5e415ea82c437ca2f41209/users/6bdd02ab3fac4ce898a7d6c13dddbda7/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:27.649494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:27.674815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b961ede-8cd6-47a5-b64d-d2adfa0ea871 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:27.782305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:27.797717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178acb2-121a-4c44-8568-1759eeb38337 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:27.815936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:27.817798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:27.818245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:27.818690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:27.820707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:27.828146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:27.859406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:27.860106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:27.860387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:27.862457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 875/1755] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:27.865237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:27.866023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:27.910787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dd505-4d87-4842-b3e2-f64b6e476e8c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:27.921482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:27.923034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:27.924283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:27.925086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:27.931288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:27.931930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:27.932850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:27.934858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:27.970038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 881/1756] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:27.975013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:27.988691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 876/1757] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:27.994255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:28.028444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42b428-7e83-4283-be66-a27cf55d383f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:28.031280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fa8ed-0801-4612-ab19-472506caa4a6 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:28.044043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b1932-497c-420f-89b8-8c21adbe5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:28.047532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1932-497c-420f-89b8-8c21adbe5107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:28.048076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1932-497c-420f-89b8-8c21adbe5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:28.049089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1932-497c-420f-89b8-8c21adbe5107 admin admin] PATH_INFO: `/v3/projects/aa7c4e421e5e415ea82c437ca2f41209/users/6bdd02ab3fac4ce898a7d6c13dddbda7/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:28.050397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:28.055283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b1932-497c-420f-89b8-8c21adbe5107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7c4e421e5e415ea82c437ca2f41209, user_id=6bdd02ab3fac4ce898a7d6c13dddbda7, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:28.055480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:28.058554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:28.060429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:28.062385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:28.063563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b1932-497c-420f-89b8-8c21adbe5107 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:28.069516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:28.108443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 877/1758] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:27 2022] PUT /identity/v3/projects/aa7c4e421e5e415ea82c437ca2f41209/users/6bdd02ab3fac4ce898a7d6c13dddbda7/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:28.114081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 882/1759] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:28.119890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:28.120405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:28.120869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:28.125198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:28.155461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9eb5-efae-47f4-8f98-f48abadd8d40 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:28.236256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] MFA Rules not processed for user `6bdd02ab3fac4ce898a7d6c13dddbda7`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:28.238839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:28.430317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91cf72-42ff-4cf3-8879-11af8af44507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:28.437527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91cf72-42ff-4cf3-8879-11af8af44507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:28.438407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91cf72-42ff-4cf3-8879-11af8af44507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:28.439233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91cf72-42ff-4cf3-8879-11af8af44507 admin admin] PATH_INFO: `/v3/projects/e0fa7a4c7feb4a219f5299973a842526/users/3a37dda65b6a44ceb18a8c44144eacb3/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:28.488489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91cf72-42ff-4cf3-8879-11af8af44507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fa7a4c7feb4a219f5299973a842526, user_id=3a37dda65b6a44ceb18a8c44144eacb3, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:28.492489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91cf72-42ff-4cf3-8879-11af8af44507 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:28.511731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 878/1760] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:28.515844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:28.522487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:28.526040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:28.544675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 883/1761] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:28 2022] PUT /identity/v3/projects/e0fa7a4c7feb4a219f5299973a842526/users/3a37dda65b6a44ceb18a8c44144eacb3/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:28.560203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1120-59ef-42d3-8c48-1bb83281d166 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:28.560642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1120-59ef-42d3-8c48-1bb83281d166 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:28.560801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1120-59ef-42d3-8c48-1bb83281d166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:28.675288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-da6d1120-59ef-42d3-8c48-1bb83281d166 None None] MFA Rules not processed for user `3a37dda65b6a44ceb18a8c44144eacb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:28.676700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-da6d1120-59ef-42d3-8c48-1bb83281d166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:28.762751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b91fa1-72b5-4af1-b1a3-fdc927a6da32 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:28.860028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 884/1762] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:28.864685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1120-59ef-42d3-8c48-1bb83281d166 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:28.930747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:28.931703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:28.934153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:28.934474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:28.986175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:29.037459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1120-59ef-42d3-8c48-1bb83281d166 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:29.049638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b8c89-febf-47db-aacd-fc14f0c58ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:29.050380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8c89-febf-47db-aacd-fc14f0c58ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:29.050717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8c89-febf-47db-aacd-fc14f0c58ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:29.051053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b8c89-febf-47db-aacd-fc14f0c58ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:29.057852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b8c89-febf-47db-aacd-fc14f0c58ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:29.089484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b8c89-febf-47db-aacd-fc14f0c58ccf admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:29.123596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:29.128112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:29.175338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 879/1763] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:29.196044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 885/1764] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:28 2022] POST /identity/v3/projects => generated 375 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:29.197487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:29.228200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d247-efed-48e6-8713-0578d1fe0ca2 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:29.367704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b5c96-ba84-4d0f-b756-a887cb1d6474 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:29.368432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b5c96-ba84-4d0f-b756-a887cb1d6474 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:29.368432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b5c96-ba84-4d0f-b756-a887cb1d6474 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:29.370054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 886/1765] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:56:29.413179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b5c96-ba84-4d0f-b756-a887cb1d6474 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:29.480535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea715-0284-47ad-9604-ce10a65bb6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:29.481336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea715-0284-47ad-9604-ce10a65bb6ef admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:29.481722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea715-0284-47ad-9604-ce10a65bb6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:29.482296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea715-0284-47ad-9604-ce10a65bb6ef admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:29.484320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea715-0284-47ad-9604-ce10a65bb6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:29.494270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea715-0284-47ad-9604-ce10a65bb6ef admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:29.571270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 880/1766] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:29 2022] POST /identity/v3/users => generated 294 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:29.576589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f450-9949-4e94-84d6-180e21577383 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:29.576879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f450-9949-4e94-84d6-180e21577383 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:29.577725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f450-9949-4e94-84d6-180e21577383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:29.644966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1951f450-9949-4e94-84d6-180e21577383 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:29.647019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1951f450-9949-4e94-84d6-180e21577383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:29.666555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b5c96-ba84-4d0f-b756-a887cb1d6474 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:29.684741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:29.686676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:29.689393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:29.690499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:29.699039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:29.802998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:29.841829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 881/1767] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:29.842667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951f450-9949-4e94-84d6-180e21577383 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:29.876404 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951f450-9949-4e94-84d6-180e21577383 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:29.915057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:29.916717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:29.917991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:29.918665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:29.919047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:29.919328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:29.919988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:29.921728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:29.962949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 887/1768] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:29 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:29.990697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:29.994395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 882/1769] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:30.014699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc3dda-c791-4caf-9831-826655a7cf8b service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:30.043255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:30.044313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:30.045847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:30.046297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] PATH_INFO: `/v3/projects/255720eecc9f482b8f087974dbc446b2/users/4fb12ba856f64e8683bb1666384bfee5/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:30.134841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255720eecc9f482b8f087974dbc446b2, user_id=4fb12ba856f64e8683bb1666384bfee5, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:30.146089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:30.213405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 888/1770] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:29 2022] PUT /identity/v3/projects/255720eecc9f482b8f087974dbc446b2/users/4fb12ba856f64e8683bb1666384bfee5/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:30.217630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:30.240753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67729-29a2-42b8-a774-d60d6f7c0c52 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:30.376442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:30.549858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0b515-e362-4c3d-a247-b7a391d12b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:30.552504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b515-e362-4c3d-a247-b7a391d12b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:30.552792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b515-e362-4c3d-a247-b7a391d12b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:30.555762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b515-e362-4c3d-a247-b7a391d12b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:30.556471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0b515-e362-4c3d-a247-b7a391d12b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:30.569411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0b515-e362-4c3d-a247-b7a391d12b2a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:30.628436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:30.640041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 883/1771] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:30.645754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5ecf-a892-46ac-9fdd-3f618c3a83b4 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:30.665539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:30.667191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:30.668735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:30.673530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] PATH_INFO: `/v3/projects/255720eecc9f482b8f087974dbc446b2/users/4fb12ba856f64e8683bb1666384bfee5/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:30.690679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255720eecc9f482b8f087974dbc446b2, user_id=4fb12ba856f64e8683bb1666384bfee5, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:30.706998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:30.776188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 889/1772] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:30 2022] PUT /identity/v3/projects/255720eecc9f482b8f087974dbc446b2/users/4fb12ba856f64e8683bb1666384bfee5/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:30.778511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:30.778829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:30.779226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:30.883286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] MFA Rules not processed for user `4fb12ba856f64e8683bb1666384bfee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:30.888038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:31.314893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 884/1773] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:31.421239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:31.604586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d6ce-99d0-4ddc-b3cf-2d6ee79c41f1 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:31.617218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ceef0-d250-452a-b96d-807d952c241e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:31.618028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ceef0-d250-452a-b96d-807d952c241e service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:31.619361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ceef0-d250-452a-b96d-807d952c241e service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:31.621275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ceef0-d250-452a-b96d-807d952c241e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:31.914592 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ceef0-d250-452a-b96d-807d952c241e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:31.916058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ceef0-d250-452a-b96d-807d952c241e service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:31.987849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 890/1774] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:32.235824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:32.237350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:32.454329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108014d7-58ad-47f2-80e9-c6de1f729e90 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:32.497394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34091887-5cbc-47c2-a07d-daf0b47cbfd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:32.497394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34091887-5cbc-47c2-a07d-daf0b47cbfd3 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:32.497394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34091887-5cbc-47c2-a07d-daf0b47cbfd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:32.497394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34091887-5cbc-47c2-a07d-daf0b47cbfd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:32.533182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34091887-5cbc-47c2-a07d-daf0b47cbfd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:32.534884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34091887-5cbc-47c2-a07d-daf0b47cbfd3 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:32.579361 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 885/1775] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:34.625384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c07a-d0ca-4abd-8ee7-4a0cf0851505 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:34.626561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c07a-d0ca-4abd-8ee7-4a0cf0851505 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:34.626561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c07a-d0ca-4abd-8ee7-4a0cf0851505 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:34.627539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 891/1776] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:56:34.799484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:34.800077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:34.800077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:34.837924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:34.842470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:34.866084 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 886/1777] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:35.503854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701c07a-d0ca-4abd-8ee7-4a0cf0851505 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:35.505680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c701c07a-d0ca-4abd-8ee7-4a0cf0851505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:35.544675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701c07a-d0ca-4abd-8ee7-4a0cf0851505 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:35.552752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:35.553603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:35.554059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:35.554475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:35.604449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:35.606945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:35.651221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:35.656470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:35.672766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 892/1778] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:35.682000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef783d-02d2-4dce-8fce-8c42172d1557 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:35.690031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a16927-4323-46f2-953d-189a1ada42b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:35.690904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16927-4323-46f2-953d-189a1ada42b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:35.695769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16927-4323-46f2-953d-189a1ada42b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:35.696267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16927-4323-46f2-953d-189a1ada42b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:35.716303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a16927-4323-46f2-953d-189a1ada42b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:35.718321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a16927-4323-46f2-953d-189a1ada42b3 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:35.755705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 887/1779] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:35.912239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:35.914493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:35.995201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:36.064590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80875-0fa8-4811-aaa4-aa8376f5a5f8 service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:36.072721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:36.076345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:36.077037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:36.078099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] PATH_INFO: `/v3/users/e70dc603e4ef4eaa88614f945fd7fde9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:36.083569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70dc603e4ef4eaa88614f945fd7fde9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:36.091341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:36.203098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70dc603e4ef4eaa88614f945fd7fde9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.229646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70dc603e4ef4eaa88614f945fd7fde9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.243660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70dc603e4ef4eaa88614f945fd7fde9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.244531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70dc603e4ef4eaa88614f945fd7fde9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.270597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70dc603e4ef4eaa88614f945fd7fde9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.292472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 893/1780] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:35 2022] DELETE /identity/v3/users/e70dc603e4ef4eaa88614f945fd7fde9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:36.296804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:36.297354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:36.297608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:36.347227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:36.348640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:36.379191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:36.545595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 888/1781] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:36.559713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:36.561207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:36.673312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f470-873e-433c-87b9-b537766c95a9 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:36.679047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5df0f4-b45a-415b-ba7b-5f0dad4a0edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:36.679676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5df0f4-b45a-415b-ba7b-5f0dad4a0edd service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:36.680121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5df0f4-b45a-415b-ba7b-5f0dad4a0edd service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:36.680482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5df0f4-b45a-415b-ba7b-5f0dad4a0edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:36.693778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5df0f4-b45a-415b-ba7b-5f0dad4a0edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:36.696342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5df0f4-b45a-415b-ba7b-5f0dad4a0edd service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:36.708325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 894/1782] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:36.775511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:36.777100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:36.791394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30acd-5f24-4e84-89a0-a5337cf62684 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:36.797535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:36.798177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:36.798454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:36.798727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] PATH_INFO: `/v3/users/bf170b1b74cf42eca61917ef22b1c629` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:36.800468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf170b1b74cf42eca61917ef22b1c629)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:36.802554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:36.859376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf170b1b74cf42eca61917ef22b1c629'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.869849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf170b1b74cf42eca61917ef22b1c629'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.870615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf170b1b74cf42eca61917ef22b1c629'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.903486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf170b1b74cf42eca61917ef22b1c629'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.913317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf170b1b74cf42eca61917ef22b1c629'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:36.920861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 889/1783] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:36 2022] DELETE /identity/v3/users/bf170b1b74cf42eca61917ef22b1c629 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:36.925699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:36.925990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:36.926252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:36.949507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:36.951027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:37.009359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:37.028874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 895/1784] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:37.039959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:37.041528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:37.106452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020761c4-667e-4102-91f8-0cd335940221 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:37.110345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:37.110963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:37.111235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:37.111498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:37.122036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:37.123601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:37.134976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 890/1785] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:37.142907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:37.144321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:37.157643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ed4ff-2e02-4b42-906c-1938eb040b86 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:37.163572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:37.164992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:37.165325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:37.165582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] PATH_INFO: `/v3/projects/71019ce853b5470cb94fc285761b4950` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:37.167425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=71019ce853b5470cb94fc285761b4950)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:37.169368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:37.221237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71019ce853b5470cb94fc285761b4950', 'request_id': 'req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.229092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71019ce853b5470cb94fc285761b4950', 'request_id': 'req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.235175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71019ce853b5470cb94fc285761b4950', 'request_id': 'req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.247355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] The token cache is being invalidate because project 71019ce853b5470cb94fc285761b4950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:37.247662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.248340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.250346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 896/1786] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:37 2022] DELETE /identity/v3/projects/71019ce853b5470cb94fc285761b4950 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:37.254135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:37.264956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9f9bc-7c18-4f29-811a-39764563647e service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:37.295924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:37.329820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:37.331651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:37.331651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:37.331651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] PATH_INFO: `/v3/users/7e38e47537b94452a489758d46b85ccb` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:37.332488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e38e47537b94452a489758d46b85ccb)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:37.334546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:37.384761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e38e47537b94452a489758d46b85ccb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.393259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e38e47537b94452a489758d46b85ccb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.393992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e38e47537b94452a489758d46b85ccb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.407849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e38e47537b94452a489758d46b85ccb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.419331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e38e47537b94452a489758d46b85ccb'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.426147 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 891/1787] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:37 2022] DELETE /identity/v3/users/7e38e47537b94452a489758d46b85ccb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:37.439054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:37.444222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:37.487108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf2e5a-472a-4a38-97d9-2c8e6601a94f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:37.566213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:37.567697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:37.567697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:37.568106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] PATH_INFO: `/v3/projects/c4bd712b7d6d4938a6ca0e7e695356c8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:37.574280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bd712b7d6d4938a6ca0e7e695356c8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:37.579184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:37.714097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bd712b7d6d4938a6ca0e7e695356c8', 'request_id': 'req-91a38ac5-5530-4536-a1b9-9744c66976d9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.724092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bd712b7d6d4938a6ca0e7e695356c8', 'request_id': 'req-91a38ac5-5530-4536-a1b9-9744c66976d9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.732697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bd712b7d6d4938a6ca0e7e695356c8', 'request_id': 'req-91a38ac5-5530-4536-a1b9-9744c66976d9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.747115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] The token cache is being invalidate because project c4bd712b7d6d4938a6ca0e7e695356c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:37.747562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.748318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:37.750139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 897/1788] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:37 2022] DELETE /identity/v3/projects/c4bd712b7d6d4938a6ca0e7e695356c8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:37.754536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:37.756398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:37.783279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd5a1-72f8-4d38-85a8-3d202c8c2a53 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:37.878194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:37.880000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:37.891298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:37.891924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:37.892693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:37.893087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:37.893461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] PATH_INFO: `/v3/users/6bdd02ab3fac4ce898a7d6c13dddbda7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:37.905712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdd02ab3fac4ce898a7d6c13dddbda7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:37.908414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.028744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdd02ab3fac4ce898a7d6c13dddbda7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.041165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:38.046354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdd02ab3fac4ce898a7d6c13dddbda7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.047252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdd02ab3fac4ce898a7d6c13dddbda7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.069448 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdd02ab3fac4ce898a7d6c13dddbda7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.074737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38ac5-5530-4536-a1b9-9744c66976d9 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:38.083289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-caa9a886-ab97-402f-9d24-5eeeae3a9ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdd02ab3fac4ce898a7d6c13dddbda7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.095249 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:38.095972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.096281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.096553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] PATH_INFO: `/v3/projects/1cb7bd9571534462b7c74ea0793a79b9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.097171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 892/1789] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:37 2022] DELETE /identity/v3/users/6bdd02ab3fac4ce898a7d6c13dddbda7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:38.100745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb7bd9571534462b7c74ea0793a79b9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:38.103935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.229084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb7bd9571534462b7c74ea0793a79b9', 'request_id': 'req-26a02190-5d7e-426c-b29c-88f8e8776c5b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.249118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb7bd9571534462b7c74ea0793a79b9', 'request_id': 'req-26a02190-5d7e-426c-b29c-88f8e8776c5b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.260250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb7bd9571534462b7c74ea0793a79b9', 'request_id': 'req-26a02190-5d7e-426c-b29c-88f8e8776c5b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.276825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] The token cache is being invalidate because project 1cb7bd9571534462b7c74ea0793a79b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:38.277179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.278123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26a02190-5d7e-426c-b29c-88f8e8776c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:38.280464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 898/1790] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:37 2022] DELETE /identity/v3/projects/1cb7bd9571534462b7c74ea0793a79b9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:38.286322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcca89d-1bab-41b8-ba57-df65ba0b9ac9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.286702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcca89d-1bab-41b8-ba57-df65ba0b9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.287043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcca89d-1bab-41b8-ba57-df65ba0b9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.313531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1bcca89d-1bab-41b8-ba57-df65ba0b9ac9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:38.314849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1bcca89d-1bab-41b8-ba57-df65ba0b9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:38.391114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 893/1791] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:38.399660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f27d-549c-45ac-83f1-d0ce8e686a50 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.400020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f27d-549c-45ac-83f1-d0ce8e686a50 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.400509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f27d-549c-45ac-83f1-d0ce8e686a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.427018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b829f27d-549c-45ac-83f1-d0ce8e686a50 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:38.428240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b829f27d-549c-45ac-83f1-d0ce8e686a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:38.442872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 899/1792] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:38.444102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcca89d-1bab-41b8-ba57-df65ba0b9ac9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:38.455040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcca89d-1bab-41b8-ba57-df65ba0b9ac9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:38.459888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:38.460637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.460968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.461277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.461933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:38.462817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:38.469555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.484205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 894/1793] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:38.489762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829f27d-549c-45ac-83f1-d0ce8e686a50 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:38.510055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829f27d-549c-45ac-83f1-d0ce8e686a50 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:38.520048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:38.521055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.522589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.522991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.524170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:38.526189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.565594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 900/1794] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:38 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:38.573033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:38.611483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbc610-d519-404b-85b2-473fa01ebd37 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:38.705126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:38.705788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.706069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.706344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.707285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:38.710972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.738125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 895/1795] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:38 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:38.743197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:38.754773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87baeee-9640-49fa-ad7f-54272818f328 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:38.763184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:38.763896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.764442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.764786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.765546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:38.767394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.783023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:38.783506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 901/1796] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:38.801451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3a8d7-c1ef-4ae9-a508-c58d5412b160 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:38.808553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f84f6-f5a7-49af-8b58-19fcba222900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:38.809330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f84f6-f5a7-49af-8b58-19fcba222900 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.809693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f84f6-f5a7-49af-8b58-19fcba222900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.810484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f84f6-f5a7-49af-8b58-19fcba222900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.810775 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f84f6-f5a7-49af-8b58-19fcba222900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:38.812452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f84f6-f5a7-49af-8b58-19fcba222900 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.828238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 896/1797] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:38.830996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:38.843937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f245f9-59f2-4df0-aa97-2f99bacca996 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:38.854156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:38.854953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.855321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.856066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] PATH_INFO: `/v3/projects/27aad893ac8c4e5d9731655739980173/users/a34b42da69ad42b68d8d968fad1357c5/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.879772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27aad893ac8c4e5d9731655739980173, user_id=a34b42da69ad42b68d8d968fad1357c5, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:38.883731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:38.918068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 902/1798] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:38 2022] PUT /identity/v3/projects/27aad893ac8c4e5d9731655739980173/users/a34b42da69ad42b68d8d968fad1357c5/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:38.918942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b60e9-7c89-4553-804e-080984d69a81 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:38.919377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b60e9-7c89-4553-804e-080984d69a81 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:38.919797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b60e9-7c89-4553-804e-080984d69a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:38.960857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-752b60e9-7c89-4553-804e-080984d69a81 None None] MFA Rules not processed for user `a34b42da69ad42b68d8d968fad1357c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:38.963264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-752b60e9-7c89-4553-804e-080984d69a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:39.000986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:39.088452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 897/1799] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:39.094252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.164983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:39.266012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a7f87-4791-4c13-b401-5f144b0693c6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.271805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.272571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.273672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.274435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.275685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.287907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.317577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 903/1800] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:39 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:39.322850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b60e9-7c89-4553-804e-080984d69a81 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.337864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b60e9-7c89-4553-804e-080984d69a81 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.418125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.420284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:39.432268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.433511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.433863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.434177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.434765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.447053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.489896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 898/1801] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:39 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:39.491094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.504498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d01b1-eafe-4a0d-aaf7-67943c6ec367 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.510006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.510621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.510889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.511152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.511842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.513686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.524886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 899/1802] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:39.529256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.540291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829204-a9cd-4a45-90d3-70cb754dbb50 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.546281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.546845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.546845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.547208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] PATH_INFO: `/v3/projects/f038ec73cc4f43b1813d8efee37f8a7f/users/bd796aab49454f0dbe6a51fcfbd5c421/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.559540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9df4d-6deb-48e4-90fa-6ff763d165b8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.564689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.565696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.565974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.566717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] PATH_INFO: `/v3/projects/aa7c4e421e5e415ea82c437ca2f41209` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.568118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7c4e421e5e415ea82c437ca2f41209)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.575542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f038ec73cc4f43b1813d8efee37f8a7f, user_id=bd796aab49454f0dbe6a51fcfbd5c421, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.575815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.575893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.594642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 900/1803] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:39 2022] PUT /identity/v3/projects/f038ec73cc4f43b1813d8efee37f8a7f/users/bd796aab49454f0dbe6a51fcfbd5c421/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:39.598626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.642884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7c4e421e5e415ea82c437ca2f41209', 'request_id': 'req-52af6400-a3e3-4847-92b4-43904e1402d2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:39.660921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7c4e421e5e415ea82c437ca2f41209', 'request_id': 'req-52af6400-a3e3-4847-92b4-43904e1402d2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:39.671880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7c4e421e5e415ea82c437ca2f41209', 'request_id': 'req-52af6400-a3e3-4847-92b4-43904e1402d2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:39.687753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d28f67-185e-40f0-85d8-144fe4ba7f43 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.688429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] The token cache is being invalidate because project aa7c4e421e5e415ea82c437ca2f41209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:39.688726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:39.689435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-52af6400-a3e3-4847-92b4-43904e1402d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:39.690966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 904/1804] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:39 2022] DELETE /identity/v3/projects/aa7c4e421e5e415ea82c437ca2f41209 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:39.697243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3f20-b7b6-4906-a48f-cfbe9bd10e7f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.697841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3f20-b7b6-4906-a48f-cfbe9bd10e7f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.698120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3f20-b7b6-4906-a48f-cfbe9bd10e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.727867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fb1d3f20-b7b6-4906-a48f-cfbe9bd10e7f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:39.728155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:39.729902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fb1d3f20-b7b6-4906-a48f-cfbe9bd10e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:39.777406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.778025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.778306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.778582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.779237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.780923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.792993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 901/1805] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:39.796708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.799124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:39.801240 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:39.822602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75595a4-bd77-44fc-a85a-cad174bd0ffa admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.829228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdccd1-7f95-453c-a5f4-be7cf4118b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.829927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdccd1-7f95-453c-a5f4-be7cf4118b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.830304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdccd1-7f95-453c-a5f4-be7cf4118b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.830714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdccd1-7f95-453c-a5f4-be7cf4118b1a admin admin] PATH_INFO: `/v3/projects/f038ec73cc4f43b1813d8efee37f8a7f/users/bd796aab49454f0dbe6a51fcfbd5c421/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.833266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdccd1-7f95-453c-a5f4-be7cf4118b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f038ec73cc4f43b1813d8efee37f8a7f, user_id=bd796aab49454f0dbe6a51fcfbd5c421, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.837704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 905/1806] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:39.838893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdccd1-7f95-453c-a5f4-be7cf4118b1a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.845319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b56ca-c9a2-4ae3-bf23-b4b8c7eff524 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.845482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b56ca-c9a2-4ae3-bf23-b4b8c7eff524 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.845629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b56ca-c9a2-4ae3-bf23-b4b8c7eff524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.854130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 902/1807] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:39 2022] PUT /identity/v3/projects/f038ec73cc4f43b1813d8efee37f8a7f/users/bd796aab49454f0dbe6a51fcfbd5c421/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:39.865637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.865922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.866194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.868988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3c9b56ca-c9a2-4ae3-bf23-b4b8c7eff524 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:39.870198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3c9b56ca-c9a2-4ae3-bf23-b4b8c7eff524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:39.901989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] MFA Rules not processed for user `bd796aab49454f0dbe6a51fcfbd5c421`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:39.903218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:39.935411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 906/1808] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:39.940156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b56ca-c9a2-4ae3-bf23-b4b8c7eff524 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.951512 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b56ca-c9a2-4ae3-bf23-b4b8c7eff524 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.956458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.957130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.957351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.957639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.958293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:39.958597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.960798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:39.973912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 907/1809] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:39.978801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.981233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 903/1810] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:39.989666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2991af-bb9d-469d-a68f-8560fa5ebf36 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:39.994479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:39.995244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:39.995908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:39.996325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:39.996593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:39.996692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:39.997329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:39.999308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.033547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 908/1811] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:39 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:40.034722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.057082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cb2f6-c221-47f5-aca2-7aeaf148476b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.104834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d65bb-c9a7-43c6-b204-71be196bda78 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.108777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.109418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.109694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.109962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.110344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.110945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.111226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.111498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.112132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.114161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.114330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:40.141190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 909/1812] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:40 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:40.142781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.153028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4c0ef-1a20-403c-b988-cd38ffc57e5b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.157686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.158275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.158554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.158825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.159460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.161037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.172046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 910/1813] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:40.175693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.175918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.177161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.185420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8008a-67f8-40f6-af82-5ecc9e56b391 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.186798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 904/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:40.192522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.193183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.193495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.193720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.194363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.198507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.210013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 911/1815] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:40.215844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.231617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238999-e158-4061-9371-9e5015eade23 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.236790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c660054-add9-44a0-ad1b-c28ea0af9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.237622 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c660054-add9-44a0-ad1b-c28ea0af9b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.237903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c660054-add9-44a0-ad1b-c28ea0af9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.238182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c660054-add9-44a0-ad1b-c28ea0af9b47 admin admin] PATH_INFO: `/v3/projects/f2d3803a79b44496b0bfd228111446dc/users/8af4f10c20594599a6dec7f276910047/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.258109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c660054-add9-44a0-ad1b-c28ea0af9b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d3803a79b44496b0bfd228111446dc, user_id=8af4f10c20594599a6dec7f276910047, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.266533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c660054-add9-44a0-ad1b-c28ea0af9b47 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.267907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.279051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424eb65-ae9d-442f-aead-abfe930ead14 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.283844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 905/1816] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:40 2022] PUT /identity/v3/projects/f2d3803a79b44496b0bfd228111446dc/users/8af4f10c20594599a6dec7f276910047/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:40.296696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fdb0f-8d9f-4ab5-b5ee-76d35f1e9cc0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.296696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fdb0f-8d9f-4ab5-b5ee-76d35f1e9cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.297011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fdb0f-8d9f-4ab5-b5ee-76d35f1e9cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.304877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:40.335008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-121fdb0f-8d9f-4ab5-b5ee-76d35f1e9cc0 None None] MFA Rules not processed for user `8af4f10c20594599a6dec7f276910047`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:40.336931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-121fdb0f-8d9f-4ab5-b5ee-76d35f1e9cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:40.381317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.382773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.383200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.383640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] PATH_INFO: `/v3/users/a34b42da69ad42b68d8d968fad1357c5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.385708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34b42da69ad42b68d8d968fad1357c5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.387666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.467636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 906/1817] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:40.468864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fdb0f-8d9f-4ab5-b5ee-76d35f1e9cc0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.474390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34b42da69ad42b68d8d968fad1357c5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:40.483952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fdb0f-8d9f-4ab5-b5ee-76d35f1e9cc0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.492000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.492000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.492000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.492000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.492461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34b42da69ad42b68d8d968fad1357c5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:40.492549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.496028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.519360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34b42da69ad42b68d8d968fad1357c5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:40.520569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34b42da69ad42b68d8d968fad1357c5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:40.529355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b57f74bc-0789-4aee-af79-14e15fbe8201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34b42da69ad42b68d8d968fad1357c5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:40.535764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 912/1818] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:40 2022] DELETE /identity/v3/users/a34b42da69ad42b68d8d968fad1357c5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:40.540120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.540403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.540682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.541365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 907/1819] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:40 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:40.545489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.547263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:40.560491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:40.561716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:40.598501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:40.621872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906a6eb-5979-42c0-9b4c-3e32760c7e9a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.629335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.629949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.630325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.630719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.631311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.633896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 913/1820] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:40.634211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.643407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.644783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:40.672153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 908/1821] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:40 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:40.673072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.685128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace642b-7541-4317-8f5b-7b197dee3ec7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.691124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.691825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.692167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.692517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.693274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.695591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.707145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 909/1822] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:40.711098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.716341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:40.723104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a14c0-d8d3-4eef-9372-1ed0ad5ed610 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.731353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b4716-3171-472c-9fd8-dff2fbeae704 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.732427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.733443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.733737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.734002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] PATH_INFO: `/v3/projects/526cd08969964b928f2a30e3e7aad0d4/users/62eac3a222e44444a7f840e9cf28edce/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.737005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.737792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.738223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.738553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.751417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.753128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.765260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526cd08969964b928f2a30e3e7aad0d4, user_id=62eac3a222e44444a7f840e9cf28edce, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.767010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 914/1823] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:40.768967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.789996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 910/1824] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:40 2022] PUT /identity/v3/projects/526cd08969964b928f2a30e3e7aad0d4/users/62eac3a222e44444a7f840e9cf28edce/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:40.793939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.806365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e535-b018-4eaf-8d07-4e2ee9f009f1 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.907653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6022a-784c-4c2a-a457-a95c0b00c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.908414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6022a-784c-4c2a-a457-a95c0b00c258 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.908837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6022a-784c-4c2a-a457-a95c0b00c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.909236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6022a-784c-4c2a-a457-a95c0b00c258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.910092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6022a-784c-4c2a-a457-a95c0b00c258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.916122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6022a-784c-4c2a-a457-a95c0b00c258 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:40.945439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 915/1825] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:40.948103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:40.964160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea5a53-b381-4268-9812-3e64a8189de5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:40.980418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:40.981664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:40.981947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:40.982223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] PATH_INFO: `/v3/projects/526cd08969964b928f2a30e3e7aad0d4/users/62eac3a222e44444a7f840e9cf28edce/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:40.984626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] RBAC: Authorizing `identity:create_grant(project_id=526cd08969964b928f2a30e3e7aad0d4, user_id=62eac3a222e44444a7f840e9cf28edce, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:40.988974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:41.009367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 911/1826] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:40 2022] PUT /identity/v3/projects/526cd08969964b928f2a30e3e7aad0d4/users/62eac3a222e44444a7f840e9cf28edce/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:41.018830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:41.020416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:41.021070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:41.069170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] MFA Rules not processed for user `62eac3a222e44444a7f840e9cf28edce`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:41.072022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:41.181580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 916/1827] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:41.195130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:41.196961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:41.234338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:41.236098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:41.272973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dcd2-298f-4cc2-b7ae-e4c35d4f703a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:41.277413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:41.278047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:41.278323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:41.278584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:41.288208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:41.290285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:41.300713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 912/1828] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:41.306284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86db0a-6e82-41a3-8d63-1b267399d441 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:41.311978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:41.312807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:41.313254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:41.313607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] PATH_INFO: `/v3/projects/27aad893ac8c4e5d9731655739980173` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:41.315029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27aad893ac8c4e5d9731655739980173)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:41.317412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:41.327116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:41.378482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27aad893ac8c4e5d9731655739980173', 'request_id': 'req-0aa2349b-046b-4551-af53-0b7a43f211b8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.392313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27aad893ac8c4e5d9731655739980173', 'request_id': 'req-0aa2349b-046b-4551-af53-0b7a43f211b8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.396456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:41.399455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27aad893ac8c4e5d9731655739980173', 'request_id': 'req-0aa2349b-046b-4551-af53-0b7a43f211b8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.407298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d008b3-9655-467c-8ada-b89303058879 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:41.415034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] The token cache is being invalidate because project 27aad893ac8c4e5d9731655739980173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:41.415536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.416222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.417848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 917/1829] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:41 2022] DELETE /identity/v3/projects/27aad893ac8c4e5d9731655739980173 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:41.422096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:41.423462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:41.460839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:41.461710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:41.462056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:41.462337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:41.464205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:41.494245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2349b-046b-4551-af53-0b7a43f211b8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:41.502700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:41.502700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:41.502700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:41.502700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] PATH_INFO: `/v3/users/bd796aab49454f0dbe6a51fcfbd5c421` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:41.503653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd796aab49454f0dbe6a51fcfbd5c421)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:41.506180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:41.528374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:41.557847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:41.559716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:41.591003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 913/1830] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:41.597444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd796aab49454f0dbe6a51fcfbd5c421'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.619901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd796aab49454f0dbe6a51fcfbd5c421'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.631031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd796aab49454f0dbe6a51fcfbd5c421'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.632797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd796aab49454f0dbe6a51fcfbd5c421'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.647089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f3ddb363-7736-4a46-80b3-83e6f66b41ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd796aab49454f0dbe6a51fcfbd5c421'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:41.659437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 918/1831] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:41 2022] DELETE /identity/v3/users/bd796aab49454f0dbe6a51fcfbd5c421 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:41.978825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:41.980481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:41.999446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc4ffc-f6ad-4500-a9cc-b7c73df5dc56 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:42.068632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:42.069301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.069644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.069995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] PATH_INFO: `/v3/users/8af4f10c20594599a6dec7f276910047` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.071221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af4f10c20594599a6dec7f276910047)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:42.073169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:42.137851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af4f10c20594599a6dec7f276910047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.150147 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af4f10c20594599a6dec7f276910047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.150870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af4f10c20594599a6dec7f276910047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.200375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af4f10c20594599a6dec7f276910047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.212235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af4f10c20594599a6dec7f276910047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.225598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 914/1832] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:41 2022] DELETE /identity/v3/users/8af4f10c20594599a6dec7f276910047 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:42.227710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.228513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.228786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.264352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:42.268006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:42.288094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:42.378187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:42.380161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:42.419744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 919/1833] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:42.435626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:42.437389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:42.538841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a202932-7f7a-45f6-a58a-fa40ef6a4a78 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:42.547565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360e615-65a0-408b-9499-877082753047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:42.549566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e615-65a0-408b-9499-877082753047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.550254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e615-65a0-408b-9499-877082753047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.550934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e615-65a0-408b-9499-877082753047 admin admin] PATH_INFO: `/v3/projects/f038ec73cc4f43b1813d8efee37f8a7f` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.553174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360e615-65a0-408b-9499-877082753047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f038ec73cc4f43b1813d8efee37f8a7f)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:42.555524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67866f0-2477-4b77-ac35-22f937c2fd3a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:42.555795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360e615-65a0-408b-9499-877082753047 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:42.558575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:42.560607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841745d-c3fd-4152-b4ee-4e528ef2d826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:42.561502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841745d-c3fd-4152-b4ee-4e528ef2d826 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.561882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841745d-c3fd-4152-b4ee-4e528ef2d826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.562254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841745d-c3fd-4152-b4ee-4e528ef2d826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.584148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841745d-c3fd-4152-b4ee-4e528ef2d826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:42.584148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841745d-c3fd-4152-b4ee-4e528ef2d826 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:42.593863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 920/1834] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:42.646253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1360e615-65a0-408b-9499-877082753047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f038ec73cc4f43b1813d8efee37f8a7f', 'request_id': 'req-1360e615-65a0-408b-9499-877082753047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.668218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1360e615-65a0-408b-9499-877082753047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f038ec73cc4f43b1813d8efee37f8a7f', 'request_id': 'req-1360e615-65a0-408b-9499-877082753047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.676900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1360e615-65a0-408b-9499-877082753047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f038ec73cc4f43b1813d8efee37f8a7f', 'request_id': 'req-1360e615-65a0-408b-9499-877082753047'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.692754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1360e615-65a0-408b-9499-877082753047 admin admin] The token cache is being invalidate because project f038ec73cc4f43b1813d8efee37f8a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:42.693055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1360e615-65a0-408b-9499-877082753047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.694021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1360e615-65a0-408b-9499-877082753047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:42.696916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 915/1835] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:42 2022] DELETE /identity/v3/projects/f038ec73cc4f43b1813d8efee37f8a7f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:42.702364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444ce1-1638-42e9-b72f-74ecd9aa4e29 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.702856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444ce1-1638-42e9-b72f-74ecd9aa4e29 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.703197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444ce1-1638-42e9-b72f-74ecd9aa4e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.741355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-71444ce1-1638-42e9-b72f-74ecd9aa4e29 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:42.742845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-71444ce1-1638-42e9-b72f-74ecd9aa4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:42.831231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 921/1836] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:42.839397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854193f8-b8c3-47c7-8e84-a6601952b66d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.839676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854193f8-b8c3-47c7-8e84-a6601952b66d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.839947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854193f8-b8c3-47c7-8e84-a6601952b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.861608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-854193f8-b8c3-47c7-8e84-a6601952b66d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:42.862786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-854193f8-b8c3-47c7-8e84-a6601952b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:42.873192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 916/1837] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:42.878667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71444ce1-1638-42e9-b72f-74ecd9aa4e29 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:42.892150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71444ce1-1638-42e9-b72f-74ecd9aa4e29 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:42.897252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:42.898752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.899029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.899300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.899965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:42.900264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:42.901891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:42.918211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 922/1838] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:42.919395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854193f8-b8c3-47c7-8e84-a6601952b66d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:42.932041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854193f8-b8c3-47c7-8e84-a6601952b66d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:42.937522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:42.938392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:42.938658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:42.938929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:42.939593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:42.941776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:42.974526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 917/1839] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:42 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:42.979186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:42.990244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca002f2-d824-4d99-a600-926cd7c2141d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:43.022386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:43.025688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:43.074181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:43.093344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:43.094422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.094770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.095107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.096616 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:43.097951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:43.116917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28f5b3-5b0f-4d6d-9faf-3db7f6157af8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:43.124501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:43.125190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.125477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.125768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] PATH_INFO: `/v3/projects/f2d3803a79b44496b0bfd228111446dc` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.129462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 923/1840] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:42 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:43.133349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d3803a79b44496b0bfd228111446dc)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:43.133487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:43.135327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:43.158133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7b08d-3bf7-4bd2-bc37-7609c71486c8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:43.170690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:43.171662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.173629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.173926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.174601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:43.176314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:43.189185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 924/1841] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:43.192787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:43.211908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2294-7c61-40f9-bf10-b034f957874c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:43.215271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d3803a79b44496b0bfd228111446dc', 'request_id': 'req-66b278de-6314-4f89-a162-0cebdca70d50'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.227284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d3803a79b44496b0bfd228111446dc', 'request_id': 'req-66b278de-6314-4f89-a162-0cebdca70d50'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.237401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d3803a79b44496b0bfd228111446dc', 'request_id': 'req-66b278de-6314-4f89-a162-0cebdca70d50'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.238715 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:43.256646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] The token cache is being invalidate because project f2d3803a79b44496b0bfd228111446dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:43.256929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.258522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.266636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 918/1842] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:43 2022] DELETE /identity/v3/projects/f2d3803a79b44496b0bfd228111446dc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:43.267514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:43.269873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:43.303549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:43.304776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.305052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.305524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.306180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:43.307808 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:43.321185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 925/1843] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:43.325214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:43.327132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:43.339781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d9328-78ea-4f10-8a9e-bf4cb886abd3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:43.344028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b278de-6314-4f89-a162-0cebdca70d50 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:43.344763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377db8a5-4f6e-40f2-bb7e-0bcc392f3c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:43.345478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db8a5-4f6e-40f2-bb7e-0bcc392f3c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.345761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db8a5-4f6e-40f2-bb7e-0bcc392f3c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.346034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db8a5-4f6e-40f2-bb7e-0bcc392f3c96 admin admin] PATH_INFO: `/v3/projects/eb758e92e01342c89c14267d3cd55cf6/users/fc95834a9ed14992ae1ced52824ce880/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.348656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:43.349310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.349592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.349866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] PATH_INFO: `/v3/users/62eac3a222e44444a7f840e9cf28edce` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.351543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62eac3a222e44444a7f840e9cf28edce)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:43.353540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:43.362015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377db8a5-4f6e-40f2-bb7e-0bcc392f3c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb758e92e01342c89c14267d3cd55cf6, user_id=fc95834a9ed14992ae1ced52824ce880, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:43.364633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377db8a5-4f6e-40f2-bb7e-0bcc392f3c96 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:43.378434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 926/1844] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:43 2022] PUT /identity/v3/projects/eb758e92e01342c89c14267d3cd55cf6/users/fc95834a9ed14992ae1ced52824ce880/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:43.384182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.384182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.384443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.403183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:43.403979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62eac3a222e44444a7f840e9cf28edce'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.404283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:43.414797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62eac3a222e44444a7f840e9cf28edce'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.415514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62eac3a222e44444a7f840e9cf28edce'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.428346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62eac3a222e44444a7f840e9cf28edce'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.435662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62eac3a222e44444a7f840e9cf28edce'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:43.442369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 919/1845] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:43 2022] DELETE /identity/v3/users/62eac3a222e44444a7f840e9cf28edce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:43.468284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 927/1846] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:43.479007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:43.480640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:43.543585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4db4-24d2-4739-94e8-8e45a2c1a0e2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:43.550107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:43.550696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:43.550935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:43.551226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:43.591344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:43.685108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:43.687611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:43.702993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 920/1847] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:44.060202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:44.061653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:44.082131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d4b0-a3b3-408e-830c-2e869c8b7f25 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:44.107152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:44.108037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:44.110533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:44.113339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] PATH_INFO: `/v3/projects/526cd08969964b928f2a30e3e7aad0d4` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:44.119773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526cd08969964b928f2a30e3e7aad0d4)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:44.122396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:44.203702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:44.205233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:44.224347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:44.234119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5ebd-736d-4bcf-ad3f-177bd653835d service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:44.249836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526cd08969964b928f2a30e3e7aad0d4', 'request_id': 'req-6585dd7d-5953-4af2-bdfc-52cc4b08db77'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.262579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526cd08969964b928f2a30e3e7aad0d4', 'request_id': 'req-6585dd7d-5953-4af2-bdfc-52cc4b08db77'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.273756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526cd08969964b928f2a30e3e7aad0d4', 'request_id': 'req-6585dd7d-5953-4af2-bdfc-52cc4b08db77'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.313846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] The token cache is being invalidate because project 526cd08969964b928f2a30e3e7aad0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:44.314398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.315103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6585dd7d-5953-4af2-bdfc-52cc4b08db77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.317357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 928/1848] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:44 2022] DELETE /identity/v3/projects/526cd08969964b928f2a30e3e7aad0d4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:44.325855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580fbc-f946-415d-a771-8f9ae1a7082c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:44.326141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580fbc-f946-415d-a771-8f9ae1a7082c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:44.326418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580fbc-f946-415d-a771-8f9ae1a7082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:44.373425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-24580fbc-f946-415d-a771-8f9ae1a7082c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:44.375847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-24580fbc-f946-415d-a771-8f9ae1a7082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:44.401852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:44.402620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:44.403185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:44.403334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] PATH_INFO: `/v3/users/524880f2e8b24ce987a3b5d61bfd5652` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:44.406518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524880f2e8b24ce987a3b5d61bfd5652)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:44.408780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:44.527055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 929/1849] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:44.532139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1cf3-0b94-4a4c-92a4-799e488473b6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:44.532502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1cf3-0b94-4a4c-92a4-799e488473b6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:44.532803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1cf3-0b94-4a4c-92a4-799e488473b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:44.541739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524880f2e8b24ce987a3b5d61bfd5652'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.559486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524880f2e8b24ce987a3b5d61bfd5652'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.560900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524880f2e8b24ce987a3b5d61bfd5652'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.595077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524880f2e8b24ce987a3b5d61bfd5652'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.599369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9bdc1cf3-0b94-4a4c-92a4-799e488473b6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:44.600867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9bdc1cf3-0b94-4a4c-92a4-799e488473b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:44.615684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524880f2e8b24ce987a3b5d61bfd5652'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:44.626422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 930/1850] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:44.626620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 921/1851] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:44 2022] DELETE /identity/v3/users/524880f2e8b24ce987a3b5d61bfd5652 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:44.633456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:44.634118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:44.634346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:44.634616 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:44.698366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:44.699606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:44.721561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:44.761493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672a803-e7e7-4465-b994-b57ebdc21c72 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:44.769608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:44.770935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:44.771320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:44.771695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:44.772472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:44.773251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:44.776019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:44.797003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 922/1852] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:44.799502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:44.820370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f919dc-33d1-4c35-8f71-80b5dff5c0c3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:44.831075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:44.833408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:44.833795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:44.834492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:44.837211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:44.840272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:44.859570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 931/1853] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:44.884131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:44.885746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:44.902179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 923/1854] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:44 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:44.903775 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.072805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f51b44-a3db-49a3-9674-634744b820a2 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.087357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:45.134804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025fd58-357d-45aa-aefc-7ae465e16a86 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.143317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.144181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.144634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.145053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.146043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.148510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.183139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 924/1855] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:44 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:45.187003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.190284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.191916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.192505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.193351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.206260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3898dd-f9b2-420b-be6a-058374de0a6c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.210149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.214350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.228537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.229181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.229472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.229751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.230548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.230706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 932/1856] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:45.232102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.254940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 925/1857] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:45.260858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.272115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19d72d-5ac0-4077-a3e6-bb2859c623eb service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.279270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21450b70-5cda-4b5e-8433-b9e591e27662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.280049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450b70-5cda-4b5e-8433-b9e591e27662 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.280668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450b70-5cda-4b5e-8433-b9e591e27662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.280668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450b70-5cda-4b5e-8433-b9e591e27662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.281334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21450b70-5cda-4b5e-8433-b9e591e27662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.283362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21450b70-5cda-4b5e-8433-b9e591e27662 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.300960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 933/1858] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:45.302530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.328214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27edab-92b6-4b1c-b5ac-65ec1da7bd22 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.344146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e358e2c-661b-4be5-a96c-a6d879a503a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.346304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e2c-661b-4be5-a96c-a6d879a503a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.346653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e2c-661b-4be5-a96c-a6d879a503a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.347438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358e2c-661b-4be5-a96c-a6d879a503a3 admin admin] PATH_INFO: `/v3/projects/313c9770498349efaf610e4ec47e6182/users/4d01f5ed447c4e638b710695d8b46793/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.441879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e358e2c-661b-4be5-a96c-a6d879a503a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=313c9770498349efaf610e4ec47e6182, user_id=4d01f5ed447c4e638b710695d8b46793, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.448271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e358e2c-661b-4be5-a96c-a6d879a503a3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.478165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 926/1859] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:45 2022] PUT /identity/v3/projects/313c9770498349efaf610e4ec47e6182/users/4d01f5ed447c4e638b710695d8b46793/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:45.484270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.484661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.484835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.491846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.492385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.493121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.526619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] MFA Rules not processed for user `fc95834a9ed14992ae1ced52824ce880`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:45.527922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:45.554469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] MFA Rules not processed for user `4d01f5ed447c4e638b710695d8b46793`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:45.556261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:45.644325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 934/1860] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:45.645470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.646260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:45.655896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:45.665268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 927/1861] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:45.679409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.682669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:45.792699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e39a-aaee-4b9a-9eca-1e6d9a67f0ae None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.800580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cbfcc-3679-43e2-906d-94d7f88b07b4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.801315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.802056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.802401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.802747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.804664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.806735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.807398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.807748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.807867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.808139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.819421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.822169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.836127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 928/1862] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:45.837556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.839527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:45.860543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c395f1-8890-4012-bbdd-2913b271f8c8 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.863540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 935/1863] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:45 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:45.864531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.885288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:45.930363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.931109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.931389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.931660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] PATH_INFO: `/v3/projects/116ba12a96664da0a7c0429cb40430b0` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.932783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=116ba12a96664da0a7c0429cb40430b0)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.934717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.934888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5beca-e254-4f2d-bb11-80617f5cee47 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.939686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:45.940286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:45.940570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:45.940843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:45.941516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:45.943406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:45.968544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 936/1864] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:45 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:45.969496 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:45.982788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e4899-f198-4fdf-8b0a-f2fff11b5f2f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:45.982947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116ba12a96664da0a7c0429cb40430b0', 'request_id': 'req-7eaf1d12-623d-475a-bf35-15223d26b99a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:45.991807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116ba12a96664da0a7c0429cb40430b0', 'request_id': 'req-7eaf1d12-623d-475a-bf35-15223d26b99a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:45.999276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116ba12a96664da0a7c0429cb40430b0', 'request_id': 'req-7eaf1d12-623d-475a-bf35-15223d26b99a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.013521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] The token cache is being invalidate because project 116ba12a96664da0a7c0429cb40430b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:46.013803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.014508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.016365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 929/1865] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:45 2022] DELETE /identity/v3/projects/116ba12a96664da0a7c0429cb40430b0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:46.020226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:46.021811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:46.049572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:46.050210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.050491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.051168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] PATH_INFO: `/v3/users/4d01f5ed447c4e638b710695d8b46793` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.052031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d01f5ed447c4e638b710695d8b46793)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:46.054214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:46.084631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:46.138941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1d12-623d-475a-bf35-15223d26b99a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:46.144354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:46.145259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.145541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.146265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.146466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:46.148942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:46.151079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d01f5ed447c4e638b710695d8b46793'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.174594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 930/1866] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:46.175924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d01f5ed447c4e638b710695d8b46793'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.177066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:46.184836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:46.188138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d01f5ed447c4e638b710695d8b46793'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.198192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d01f5ed447c4e638b710695d8b46793'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.212024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d01f5ed447c4e638b710695d8b46793'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.218930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411670-084a-40c5-a388-eb1d75271a20 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:46.229036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 937/1867] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:45 2022] DELETE /identity/v3/users/4d01f5ed447c4e638b710695d8b46793 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:46.230253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:46.232821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:46.236224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:46.237082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.240144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.240435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] PATH_INFO: `/v3/users/1d971d558e434046aee39352f28cedd3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.241899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d971d558e434046aee39352f28cedd3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:46.249560 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:46.271537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:46.336355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d971d558e434046aee39352f28cedd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.344017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed02aa4-44f0-4fa8-b0a6-19d7e8668888 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:46.344680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d971d558e434046aee39352f28cedd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.345420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d971d558e434046aee39352f28cedd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.349097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:46.349860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.350140 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.350415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] PATH_INFO: `/v3/projects/9534a953a2264a8e9f3751e29310e3a5/users/49bd6aed4f3c4fe98aae6a442fd3af68/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.358137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d971d558e434046aee39352f28cedd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.365438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5eb4e52-2ab3-4d79-8c5b-16c13aaa7e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d971d558e434046aee39352f28cedd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:46.366218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534a953a2264a8e9f3751e29310e3a5, user_id=49bd6aed4f3c4fe98aae6a442fd3af68, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:46.369448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:46.372313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 931/1868] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:46 2022] DELETE /identity/v3/users/1d971d558e434046aee39352f28cedd3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:46.373718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59056c60-d545-4eb6-add6-2a0fe4d88bdd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.373999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59056c60-d545-4eb6-add6-2a0fe4d88bdd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.374271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59056c60-d545-4eb6-add6-2a0fe4d88bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.387538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 938/1869] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:46 2022] PUT /identity/v3/projects/9534a953a2264a8e9f3751e29310e3a5/users/49bd6aed4f3c4fe98aae6a442fd3af68/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:46.391444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:46.393073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:46.395031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-59056c60-d545-4eb6-add6-2a0fe4d88bdd None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:46.396211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-59056c60-d545-4eb6-add6-2a0fe4d88bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:46.535035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 932/1870] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:46.562797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac032-3842-438d-93b7-c57e998cb4bb admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:46.577410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:46.578089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.578373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.578789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.579456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:46.581425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:46.599132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 939/1871] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:46.603943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59056c60-d545-4eb6-add6-2a0fe4d88bdd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:46.616555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59056c60-d545-4eb6-add6-2a0fe4d88bdd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:46.623317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c98593-f825-4568-a5a8-6b876df78bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:46.624589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98593-f825-4568-a5a8-6b876df78bed admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.624589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98593-f825-4568-a5a8-6b876df78bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.624589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c98593-f825-4568-a5a8-6b876df78bed admin admin] PATH_INFO: `/v3/projects/9534a953a2264a8e9f3751e29310e3a5/users/49bd6aed4f3c4fe98aae6a442fd3af68/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.626618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c98593-f825-4568-a5a8-6b876df78bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534a953a2264a8e9f3751e29310e3a5, user_id=49bd6aed4f3c4fe98aae6a442fd3af68, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:46.629375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c98593-f825-4568-a5a8-6b876df78bed admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:46.631737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:46.634577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:46.678528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 933/1872] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:46 2022] PUT /identity/v3/projects/9534a953a2264a8e9f3751e29310e3a5/users/49bd6aed4f3c4fe98aae6a442fd3af68/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:46.749292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489bf6e-0bea-4fca-a9e6-a669a2339a5e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:46.860255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3f0ce-f049-41cb-ab42-728a5d4f4bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:46.860742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f0ce-f049-41cb-ab42-728a5d4f4bde service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:46.861023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f0ce-f049-41cb-ab42-728a5d4f4bde service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:46.861450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f0ce-f049-41cb-ab42-728a5d4f4bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:46.880318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:46.989570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f0ce-f049-41cb-ab42-728a5d4f4bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:46.992086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f0ce-f049-41cb-ab42-728a5d4f4bde service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:47.011335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 940/1873] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:47.125487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81327e5-90b3-4469-8f83-cbad5dac6107 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:47.125831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81327e5-90b3-4469-8f83-cbad5dac6107 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:47.126041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81327e5-90b3-4469-8f83-cbad5dac6107 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:47.127490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 934/1874] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:56:47.172105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec563fd-36c3-40ae-aa80-41bf0cb2bf50 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:47.173233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec563fd-36c3-40ae-aa80-41bf0cb2bf50 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:47.174876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec563fd-36c3-40ae-aa80-41bf0cb2bf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:47.219605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9ec563fd-36c3-40ae-aa80-41bf0cb2bf50 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:47.220744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9ec563fd-36c3-40ae-aa80-41bf0cb2bf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:47.399548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 941/1875] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:47.904425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81327e5-90b3-4469-8f83-cbad5dac6107 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:47.906207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a81327e5-90b3-4469-8f83-cbad5dac6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:47.927563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81327e5-90b3-4469-8f83-cbad5dac6107 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:47.941182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:47.942215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:47.942708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:47.943471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] PATH_INFO: `/v3/projects/39fcf82d133840499e8f518b3f3ee468` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:47.947372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fcf82d133840499e8f518b3f3ee468)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:47.954376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:47.993338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:48.046619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fcf82d133840499e8f518b3f3ee468', 'request_id': 'req-323d0ccd-1e31-4476-b28f-8f058375ba7a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.054846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fcf82d133840499e8f518b3f3ee468', 'request_id': 'req-323d0ccd-1e31-4476-b28f-8f058375ba7a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.061743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fcf82d133840499e8f518b3f3ee468', 'request_id': 'req-323d0ccd-1e31-4476-b28f-8f058375ba7a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.075115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] The token cache is being invalidate because project 39fcf82d133840499e8f518b3f3ee468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:48.075484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.076218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-323d0ccd-1e31-4476-b28f-8f058375ba7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.077947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 935/1876] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:47 2022] DELETE /identity/v3/projects/39fcf82d133840499e8f518b3f3ee468 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:48.082856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.083329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.083414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.106410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:48.107719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.185437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 942/1877] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:48.197681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdbe6f-e829-48fa-8556-1229b935f8a2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.198042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdbe6f-e829-48fa-8556-1229b935f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.198311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdbe6f-e829-48fa-8556-1229b935f8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.224782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-cebdbe6f-e829-48fa-8556-1229b935f8a2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:48.232198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.233981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.244489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-cebdbe6f-e829-48fa-8556-1229b935f8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.279431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 936/1878] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:48.283537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdbe6f-e829-48fa-8556-1229b935f8a2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.301443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdbe6f-e829-48fa-8556-1229b935f8a2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.310343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:48.313375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.314416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.314808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.315273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.316133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:48.316685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.319196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.355880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 937/1879] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:56:48.356760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.370776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.386200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72c4f3-de61-4a86-acb5-f4f93c17a62f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.396585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.397475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.397627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2090-8154-4bd9-8b3b-621c1f669e6a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.398094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.398552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.401226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.403712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.404346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.404636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.404973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] PATH_INFO: `/v3/projects/313c9770498349efaf610e4ec47e6182` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.406262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313c9770498349efaf610e4ec47e6182)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.408105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.427260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.430926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.468689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 943/1880] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:48.469739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.489986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313c9770498349efaf610e4ec47e6182', 'request_id': 'req-2345d1af-7668-4206-bce8-c495c70b36b1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.500436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313c9770498349efaf610e4ec47e6182', 'request_id': 'req-2345d1af-7668-4206-bce8-c495c70b36b1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.508300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901afa46-7467-4b09-8e90-af076f4850db service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.510311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313c9770498349efaf610e4ec47e6182', 'request_id': 'req-2345d1af-7668-4206-bce8-c495c70b36b1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.525912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] The token cache is being invalidate because project 313c9770498349efaf610e4ec47e6182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:48.526473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.527549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2345d1af-7668-4206-bce8-c495c70b36b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:48.529700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 938/1881] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:48 2022] DELETE /identity/v3/projects/313c9770498349efaf610e4ec47e6182 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:48.534403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed3969-bd32-4af5-a17c-01c8219f89c6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.534870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed3969-bd32-4af5-a17c-01c8219f89c6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.535335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed3969-bd32-4af5-a17c-01c8219f89c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.559124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ffed3969-bd32-4af5-a17c-01c8219f89c6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:48.560940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ffed3969-bd32-4af5-a17c-01c8219f89c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.602999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.603925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.604533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.605054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.606219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.609193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.661748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 939/1882] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:48.664233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f89c3-f765-4cc3-8648-f2836a2a137a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.667760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 944/1883] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/projects => generated 371 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:48.668206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f89c3-f765-4cc3-8648-f2836a2a137a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.668206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f89c3-f765-4cc3-8648-f2836a2a137a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.669060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.671495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.698756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-238f89c3-f765-4cc3-8648-f2836a2a137a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:48.700618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-238f89c3-f765-4cc3-8648-f2836a2a137a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:48.710608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:48.777988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab3bd5-48d3-4d54-9a1a-73e5708f62cc admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.784546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.785293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.785710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.785990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.787181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.790455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.835816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 945/1884] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:48.837545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.854216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e24b2-6c20-45e2-843c-aaf2625f5a88 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.864070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.864696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.864975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.865280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.865928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.868130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.869338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 940/1885] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:48.873166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f89c3-f765-4cc3-8648-f2836a2a137a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.889366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 946/1886] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:48.892368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f89c3-f765-4cc3-8648-f2836a2a137a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.893297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.899078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.899853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.900144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.900420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.901088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:48.901428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.903049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.922450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 941/1887] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:56:48.923270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490818c-a245-446c-ad9c-bf043dcb2786 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.926383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.934053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.934838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.935120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.935394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.936050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.937676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.939637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296bea8-a27d-4f31-8f2b-cc09c7d1fb3f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.945791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.946411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.946692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.946970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.947604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:48.949341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 947/1888] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:48.949685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:48.953764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:48.968838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbffab-28ba-423d-971a-2bce127f1377 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:48.979175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679b39-8093-4760-af37-4295ad79d27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:48.979911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679b39-8093-4760-af37-4295ad79d27e admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:48.980190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679b39-8093-4760-af37-4295ad79d27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:48.980467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679b39-8093-4760-af37-4295ad79d27e admin admin] PATH_INFO: `/v3/projects/dcbbfe8fd0de429983fa343aee5e43fc/users/801c612f093143f2b78d9c1815ac49d8/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:48.989237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 942/1889] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:48.990330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.003163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679b39-8093-4760-af37-4295ad79d27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbbfe8fd0de429983fa343aee5e43fc, user_id=801c612f093143f2b78d9c1815ac49d8, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.006377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679b39-8093-4760-af37-4295ad79d27e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.022590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:49.055840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 948/1890] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:48 2022] PUT /identity/v3/projects/dcbbfe8fd0de429983fa343aee5e43fc/users/801c612f093143f2b78d9c1815ac49d8/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:49.059236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620cc19-98ba-425d-b43f-07f9ceb1d72b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.059594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620cc19-98ba-425d-b43f-07f9ceb1d72b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.059787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620cc19-98ba-425d-b43f-07f9ceb1d72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.111309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb243385-98b1-4751-a0cf-716e1085cfa0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.156373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9620cc19-98ba-425d-b43f-07f9ceb1d72b None None] MFA Rules not processed for user `801c612f093143f2b78d9c1815ac49d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:49.160967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9620cc19-98ba-425d-b43f-07f9ceb1d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:49.235721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.237932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.238453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.238831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.239578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.244827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.274072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 943/1891] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:48 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:49.278480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.280458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 949/1892] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:49.285319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620cc19-98ba-425d-b43f-07f9ceb1d72b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.306770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620cc19-98ba-425d-b43f-07f9ceb1d72b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.308531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136a902-4c6c-43cf-9295-0e1981c9fda0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.317019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.318158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.318604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.319282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.320935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.324251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.332872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b59cb9-cda6-4e7e-93fa-95e95379e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.334049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59cb9-cda6-4e7e-93fa-95e95379e436 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.334546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59cb9-cda6-4e7e-93fa-95e95379e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.335095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59cb9-cda6-4e7e-93fa-95e95379e436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.337133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b59cb9-cda6-4e7e-93fa-95e95379e436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.339357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b59cb9-cda6-4e7e-93fa-95e95379e436 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.365542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 944/1893] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:49.365542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d344e-102e-413c-af50-22fad41a0058 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.365807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d344e-102e-413c-af50-22fad41a0058 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.366100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d344e-102e-413c-af50-22fad41a0058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.377546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:49.396121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 950/1894] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:49 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:49.396121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.425451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ba7d344e-102e-413c-af50-22fad41a0058 None None] MFA Rules not processed for user `49bd6aed4f3c4fe98aae6a442fd3af68`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:49.432587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ba7d344e-102e-413c-af50-22fad41a0058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:49.504742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fa06a-836f-4577-9d64-ae434b041140 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.511813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.512694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.513228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.513683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.514516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.516727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.533827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 951/1895] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:49.538746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.550028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271f2a-571c-438c-8d6e-73551a591631 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.558310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563c6ef-a0bd-4830-ade6-dce57aede0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.559062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c6ef-a0bd-4830-ade6-dce57aede0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.559342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c6ef-a0bd-4830-ade6-dce57aede0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.559618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c6ef-a0bd-4830-ade6-dce57aede0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.560255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563c6ef-a0bd-4830-ade6-dce57aede0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.561481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 945/1896] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:49.562460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d344e-102e-413c-af50-22fad41a0058 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.574321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d344e-102e-413c-af50-22fad41a0058 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.575067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563c6ef-a0bd-4830-ade6-dce57aede0c9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.581176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.582194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.582194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.582382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] PATH_INFO: `/v3/projects/a336181c11614caf8c6f416effb289ff/users/de2391839754486e98198cdbaca6e1c1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.605007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a336181c11614caf8c6f416effb289ff, user_id=de2391839754486e98198cdbaca6e1c1, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.607667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.610446 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 952/1897] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:49 2022] POST /identity/v3/users => generated 293 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:49.611781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c57f79-88c5-4a80-8c77-4e1b14b1e39e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.612284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c57f79-88c5-4a80-8c77-4e1b14b1e39e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.612656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c57f79-88c5-4a80-8c77-4e1b14b1e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.627281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 946/1898] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:49 2022] PUT /identity/v3/projects/a336181c11614caf8c6f416effb289ff/users/de2391839754486e98198cdbaca6e1c1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:49.628121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.644968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d8c57f79-88c5-4a80-8c77-4e1b14b1e39e None None] MFA Rules not processed for user `fc95834a9ed14992ae1ced52824ce880`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:49.646389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d8c57f79-88c5-4a80-8c77-4e1b14b1e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:49.688106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:49.703316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26784c-105c-4cfa-ad01-75e0da022636 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.707923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.708275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 953/1899] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:49.709426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.709549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736af2d-c033-457d-9d25-0567d8a18d28 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.709786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.709888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736af2d-c033-457d-9d25-0567d8a18d28 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.710090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736af2d-c033-457d-9d25-0567d8a18d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.710227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.711020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.712687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.723652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 947/1900] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:49.724472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.726177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:49.742271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a736af2d-c033-457d-9d25-0567d8a18d28 None None] MFA Rules not processed for user `de2391839754486e98198cdbaca6e1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:49.743686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a736af2d-c033-457d-9d25-0567d8a18d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:49.790975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:49.810353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703268e7-6479-40de-9415-1874ff91df0f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.816479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.817093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.817413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.817685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.820186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:49.825245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 954/1901] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:49.830100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736af2d-c033-457d-9d25-0567d8a18d28 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.836264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.838388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.844257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736af2d-c033-457d-9d25-0567d8a18d28 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.848036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 948/1902] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:49.848862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.850236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:49.851680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.852840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.853348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.853936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] PATH_INFO: `/v3/projects/aa17e292e8b34dc7a4deaaaa1427eb54/users/4bba050a43634d4abdcffe90827859f2/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.872984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa17e292e8b34dc7a4deaaaa1427eb54, user_id=4bba050a43634d4abdcffe90827859f2, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:49.877792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:49.894951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 955/1903] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:49 2022] PUT /identity/v3/projects/aa17e292e8b34dc7a4deaaaa1427eb54/users/4bba050a43634d4abdcffe90827859f2/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:49.899699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:49.923869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ce7e4-3f5a-4a76-aa55-95ee991877e1 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.987370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:49.988106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:49.988390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:49.988668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:49.994036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4c25-4a3e-4504-8b26-f11e6194c6b2 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:49.999620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:50.000236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:50.000517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:50.000790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:50.001543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:50.004608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:50.017611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 956/1904] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:50.021931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:50.034341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d29e0-a668-4ee7-9d33-20047bb55100 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:50.041188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce142ea-6b8f-4b8e-bae8-8702e3ee84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:50.041874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce142ea-6b8f-4b8e-bae8-8702e3ee84a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:50.042075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce142ea-6b8f-4b8e-bae8-8702e3ee84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:50.042340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce142ea-6b8f-4b8e-bae8-8702e3ee84a7 admin admin] PATH_INFO: `/v3/projects/aa17e292e8b34dc7a4deaaaa1427eb54/users/4bba050a43634d4abdcffe90827859f2/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:50.044412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce142ea-6b8f-4b8e-bae8-8702e3ee84a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa17e292e8b34dc7a4deaaaa1427eb54, user_id=4bba050a43634d4abdcffe90827859f2, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:50.047121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce142ea-6b8f-4b8e-bae8-8702e3ee84a7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:50.059543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 957/1905] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:50 2022] PUT /identity/v3/projects/aa17e292e8b34dc7a4deaaaa1427eb54/users/4bba050a43634d4abdcffe90827859f2/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:50.060336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:50.062567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:50.071081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:50.071369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:50.071665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:50.072144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 949/1906] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:50.103627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] MFA Rules not processed for user `4bba050a43634d4abdcffe90827859f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:50.105315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:50.139500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:50.229227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 958/1907] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:50.241074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:50.243025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:50.255732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795519c1-faa1-43ad-9300-16985ff8a4bc service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:50.326288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d11a8-0d9a-45a9-a7e6-8a4462d2070d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:50.328285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d11a8-0d9a-45a9-a7e6-8a4462d2070d service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:50.328625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d11a8-0d9a-45a9-a7e6-8a4462d2070d service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:50.328974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d11a8-0d9a-45a9-a7e6-8a4462d2070d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:50.341137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d11a8-0d9a-45a9-a7e6-8a4462d2070d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:50.342816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d11a8-0d9a-45a9-a7e6-8a4462d2070d service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:50.349421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:50.359355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 950/1908] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:50.456161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:50.458697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:50.592306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d70bf4-b657-4ac3-ad69-916b91c7bb80 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:50.597576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:50.598220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:50.598631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:50.598952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] PATH_INFO: `/v3/users/3a37dda65b6a44ceb18a8c44144eacb3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:50.600116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a37dda65b6a44ceb18a8c44144eacb3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:50.602833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:50.683866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a37dda65b6a44ceb18a8c44144eacb3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:50.704241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a37dda65b6a44ceb18a8c44144eacb3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:50.713689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a37dda65b6a44ceb18a8c44144eacb3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:50.714961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a37dda65b6a44ceb18a8c44144eacb3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:50.738943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a37dda65b6a44ceb18a8c44144eacb3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:50.750877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 959/1909] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:50 2022] DELETE /identity/v3/users/3a37dda65b6a44ceb18a8c44144eacb3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:50.755147 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:50.755657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:50.756083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:50.780619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:50.782061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:50.881117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 951/1910] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:50.892127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:50.893711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:51.004807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:51.059494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198737f-aa2d-43d5-b18b-e9fd9879e14e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:51.072197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a1c10-bf68-42ee-a37f-2dc7689afe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:51.073833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a1c10-bf68-42ee-a37f-2dc7689afe16 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:51.074359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a1c10-bf68-42ee-a37f-2dc7689afe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:51.074857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a1c10-bf68-42ee-a37f-2dc7689afe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:51.098381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:51.100006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:51.115130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a1c10-bf68-42ee-a37f-2dc7689afe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:51.117411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a1c10-bf68-42ee-a37f-2dc7689afe16 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:51.126067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6f380-073c-4949-a895-a9f4c442d645 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:51.139431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:51.140115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:51.140396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:51.140672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] PATH_INFO: `/v3/users/801c612f093143f2b78d9c1815ac49d8` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:51.141929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801c612f093143f2b78d9c1815ac49d8)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:51.143870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:51.150949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 960/1911] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:51.255075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801c612f093143f2b78d9c1815ac49d8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.267831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801c612f093143f2b78d9c1815ac49d8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.269566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801c612f093143f2b78d9c1815ac49d8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.286092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801c612f093143f2b78d9c1815ac49d8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.296412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801c612f093143f2b78d9c1815ac49d8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.308098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 952/1912] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:51 2022] DELETE /identity/v3/users/801c612f093143f2b78d9c1815ac49d8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:51.310367 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:51.310888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:51.310888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:51.346138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:51.352695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:51.469434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 961/1913] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:51.482350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:51.484077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:51.602307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5629703-4a80-46c0-903f-7e810bc4fd04 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:51.607462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:51.608086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:51.608678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:51.608951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:51.619579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:51.621023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:51.635126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 953/1914] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:56:51.833819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:51.835871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:51.848495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fa593-ab97-40cc-995d-8f63b927b507 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:51.854359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:51.855109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:51.855470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:51.855811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] PATH_INFO: `/v3/projects/e0fa7a4c7feb4a219f5299973a842526` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:51.857246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fa7a4c7feb4a219f5299973a842526)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:51.859547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:51.961189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fa7a4c7feb4a219f5299973a842526', 'request_id': 'req-519092a5-6508-44dd-b8bf-3a18faa7a941'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.970924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fa7a4c7feb4a219f5299973a842526', 'request_id': 'req-519092a5-6508-44dd-b8bf-3a18faa7a941'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.978944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fa7a4c7feb4a219f5299973a842526', 'request_id': 'req-519092a5-6508-44dd-b8bf-3a18faa7a941'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.992456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] The token cache is being invalidate because project e0fa7a4c7feb4a219f5299973a842526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:51.992740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.993443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:51.998682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 962/1915] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:51 2022] DELETE /identity/v3/projects/e0fa7a4c7feb4a219f5299973a842526 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:52.002780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:52.031239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf01ce2-b5b8-4f60-9b3f-7b4d453a78cf service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:52.045630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:52.050131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:52.051541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:52.111463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:52.112024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:52.112498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:52.112755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] PATH_INFO: `/v3/users/4fb12ba856f64e8683bb1666384bfee5` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:52.114108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb12ba856f64e8683bb1666384bfee5)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:52.116026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:52.143096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519092a5-6508-44dd-b8bf-3a18faa7a941 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:52.149425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:52.150224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:52.150432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:52.150776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] PATH_INFO: `/v3/projects/dcbbfe8fd0de429983fa343aee5e43fc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:52.152066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbbfe8fd0de429983fa343aee5e43fc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:52.154665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:52.167581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:52.172316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb12ba856f64e8683bb1666384bfee5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.182593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb12ba856f64e8683bb1666384bfee5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.183400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb12ba856f64e8683bb1666384bfee5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.199446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb12ba856f64e8683bb1666384bfee5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.207755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb12ba856f64e8683bb1666384bfee5'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.215631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 954/1916] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:52 2022] DELETE /identity/v3/users/4fb12ba856f64e8683bb1666384bfee5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:52.219362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbbfe8fd0de429983fa343aee5e43fc', 'request_id': 'req-36bd1023-37de-4620-b224-b5d48bc59e9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.227520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbbfe8fd0de429983fa343aee5e43fc', 'request_id': 'req-36bd1023-37de-4620-b224-b5d48bc59e9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.234415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbbfe8fd0de429983fa343aee5e43fc', 'request_id': 'req-36bd1023-37de-4620-b224-b5d48bc59e9e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.246460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] The token cache is being invalidate because project dcbbfe8fd0de429983fa343aee5e43fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:52.246782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.247460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.249254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 963/1917] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:52 2022] DELETE /identity/v3/projects/dcbbfe8fd0de429983fa343aee5e43fc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:52.253076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:52.254533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:52.328432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd38c3-e900-478f-a9a6-3eea6a4c9146 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:52.333549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:52.334194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:52.334468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:52.334736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] PATH_INFO: `/v3/users/4bba050a43634d4abdcffe90827859f2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:52.337235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bba050a43634d4abdcffe90827859f2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:52.339181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:52.383373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:52.392912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bba050a43634d4abdcffe90827859f2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.402002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bba050a43634d4abdcffe90827859f2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.402730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bba050a43634d4abdcffe90827859f2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.417612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bba050a43634d4abdcffe90827859f2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.425124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bba050a43634d4abdcffe90827859f2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:52.431967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 955/1918] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:56:52 2022] DELETE /identity/v3/users/4bba050a43634d4abdcffe90827859f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:52.802721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:52.805086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:52.872911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:52.874752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:52.923935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1023-37de-4620-b224-b5d48bc59e9e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:52.984459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf85e4-83b3-4a73-ac92-da40d9c0428e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:52.990003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:52.990889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:52.991035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:52.991445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] PATH_INFO: `/v3/projects/255720eecc9f482b8f087974dbc446b2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:52.994253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=255720eecc9f482b8f087974dbc446b2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:52.996266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.051154 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.054051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.054341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.054620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] PATH_INFO: `/v3/projects/aa17e292e8b34dc7a4deaaaa1427eb54` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.058922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa17e292e8b34dc7a4deaaaa1427eb54)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.064933 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.070090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255720eecc9f482b8f087974dbc446b2', 'request_id': 'req-2ab858d5-84b4-4ec0-8cec-75193e6519d4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.082477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255720eecc9f482b8f087974dbc446b2', 'request_id': 'req-2ab858d5-84b4-4ec0-8cec-75193e6519d4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.099913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255720eecc9f482b8f087974dbc446b2', 'request_id': 'req-2ab858d5-84b4-4ec0-8cec-75193e6519d4'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.129392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] The token cache is being invalidate because project 255720eecc9f482b8f087974dbc446b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:53.129992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.131172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ab858d5-84b4-4ec0-8cec-75193e6519d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.134170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 956/1919] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:52 2022] DELETE /identity/v3/projects/255720eecc9f482b8f087974dbc446b2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:53.140262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b652586-c621-4633-9a1b-b4a0142252e1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.142223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b652586-c621-4633-9a1b-b4a0142252e1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.143467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b652586-c621-4633-9a1b-b4a0142252e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.144514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:53.149506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa17e292e8b34dc7a4deaaaa1427eb54', 'request_id': 'req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.166448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa17e292e8b34dc7a4deaaaa1427eb54', 'request_id': 'req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.181690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0b652586-c621-4633-9a1b-b4a0142252e1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:53.183339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa17e292e8b34dc7a4deaaaa1427eb54', 'request_id': 'req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.183730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0b652586-c621-4633-9a1b-b4a0142252e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:53.213014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] The token cache is being invalidate because project aa17e292e8b34dc7a4deaaaa1427eb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:56:53.213523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.214771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d6f9482-bcbb-4c41-9079-3d5ba8a4aec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:56:53.218767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 964/1920] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:56:52 2022] DELETE /identity/v3/projects/aa17e292e8b34dc7a4deaaaa1427eb54 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:53.224259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48730-2a9a-4575-8c51-8798f593002c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.224617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48730-2a9a-4575-8c51-8798f593002c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.224954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48730-2a9a-4575-8c51-8798f593002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.269665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-23e48730-2a9a-4575-8c51-8798f593002c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:53.270972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-23e48730-2a9a-4575-8c51-8798f593002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:53.287535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:53.328126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 957/1921] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:53.329937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff82cc-2fc7-4906-89e6-2adc46c0ea5a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.330393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff82cc-2fc7-4906-89e6-2adc46c0ea5a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.330665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff82cc-2fc7-4906-89e6-2adc46c0ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.353781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5eff82cc-2fc7-4906-89e6-2adc46c0ea5a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:53.355119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5eff82cc-2fc7-4906-89e6-2adc46c0ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:53.363691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 965/1922] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:53.364852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 958/1923] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:53.369531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e48730-2a9a-4575-8c51-8798f593002c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.371920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cf695-6638-4846-ab18-2d5ec8d54b16 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.372205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cf695-6638-4846-ab18-2d5ec8d54b16 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.372480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cf695-6638-4846-ab18-2d5ec8d54b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.379439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e48730-2a9a-4575-8c51-8798f593002c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.384622 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.385315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.385597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.385871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.386553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:53.386852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.388431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.392832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f00cf695-6638-4846-ab18-2d5ec8d54b16 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:53.394051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f00cf695-6638-4846-ab18-2d5ec8d54b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:53.403650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 966/1924] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:56:53.403812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 959/1925] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:53.405048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.406261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cf695-6638-4846-ab18-2d5ec8d54b16 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.416408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306bef9-a838-4e7e-909d-e0f1a2848739 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.417389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cf695-6638-4846-ab18-2d5ec8d54b16 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.422479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.423225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.423358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.423516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.423781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.423954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.424239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.424416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.424556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.425254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:56:53.425554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.426339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.427122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.440046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 960/1926] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:56:53.444405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.456121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 967/1927] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:53.456300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764429fc-b0c7-463b-8763-603e45699e60 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.460710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.515236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.515843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.516123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.516395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.517023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.518964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.525247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5648b9-9eb0-4e9e-9525-e95602a1b10a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.529877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.530483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.530763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.531390 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.531776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.533717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.550004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 961/1928] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:53.553763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.558343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 968/1929] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:53.562064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.571717 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518908-4ee5-4a4d-9597-043db60aabea admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.608180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:53.625252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c54d-d64d-4459-95c6-fc1dd0162773 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.632954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.633738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.634019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.634337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.634978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.637438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.657833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.658738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.659173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.659516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.660684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.664027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.669821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 962/1930] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:53.674295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.681190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 969/1931] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:53.684963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.685928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf8732-25cb-454b-a11d-2f9070e520cf admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.692020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.692776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.693406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.693681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.694416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.696932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.697098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6bc49-2195-4072-a249-baf9eb31baf5 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.702339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.703132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.703481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.703825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.704544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.706160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.708380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 963/1932] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:53.712335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.717069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 970/1933] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:53.721401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.725024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5252-3281-4f2f-ba5d-50ebaf48af82 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.730584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.731266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.731619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.732060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.732788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.734737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.735115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d014-bdde-4bb3-a74c-7cedfe39869a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.741971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f52632-0b5f-4c54-96df-62a94a55a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.743355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f52632-0b5f-4c54-96df-62a94a55a3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.743703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f52632-0b5f-4c54-96df-62a94a55a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.743980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f52632-0b5f-4c54-96df-62a94a55a3d3 admin admin] PATH_INFO: `/v3/projects/7e08bc1900c042f1be1f590968be40ce/users/739b5279134347e98a476edb1f622fda/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.747857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 964/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:53.751237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.760364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f52632-0b5f-4c54-96df-62a94a55a3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e08bc1900c042f1be1f590968be40ce, user_id=739b5279134347e98a476edb1f622fda, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.762953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672edbb-c113-45b1-8f2c-515f9bdae04a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:53.763039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f52632-0b5f-4c54-96df-62a94a55a3d3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.767484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c6e43-43ac-4fc3-976a-23283274b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:53.768262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c6e43-43ac-4fc3-976a-23283274b021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.768546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c6e43-43ac-4fc3-976a-23283274b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.768952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c6e43-43ac-4fc3-976a-23283274b021 admin admin] PATH_INFO: `/v3/projects/9fb4cc5f336c4ce39566406b0678153d/users/eecd58191c1f4fd69752ef3794141b63/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.778233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:53.789530 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 971/1935] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:53 2022] PUT /identity/v3/projects/7e08bc1900c042f1be1f590968be40ce/users/739b5279134347e98a476edb1f622fda/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:53.791710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3f4c-55a8-4725-8223-3177009878d5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.792460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3f4c-55a8-4725-8223-3177009878d5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.792460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3f4c-55a8-4725-8223-3177009878d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.797176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c6e43-43ac-4fc3-976a-23283274b021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb4cc5f336c4ce39566406b0678153d, user_id=eecd58191c1f4fd69752ef3794141b63, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:53.800203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c6e43-43ac-4fc3-976a-23283274b021 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:53.816410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 965/1936] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:53 2022] PUT /identity/v3/projects/9fb4cc5f336c4ce39566406b0678153d/users/eecd58191c1f4fd69752ef3794141b63/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:53.829279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a9b8-f160-4adf-9dfd-655c0ca2d0d7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:53.829896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a9b8-f160-4adf-9dfd-655c0ca2d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:53.830267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a9b8-f160-4adf-9dfd-655c0ca2d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:53.832553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b1fb3f4c-55a8-4725-8223-3177009878d5 None None] MFA Rules not processed for user `739b5279134347e98a476edb1f622fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:53.833807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b1fb3f4c-55a8-4725-8223-3177009878d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:53.872529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-beb0a9b8-f160-4adf-9dfd-655c0ca2d0d7 None None] MFA Rules not processed for user `eecd58191c1f4fd69752ef3794141b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:53.873925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-beb0a9b8-f160-4adf-9dfd-655c0ca2d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:53.920641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 972/1937] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:53.925275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3f4c-55a8-4725-8223-3177009878d5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:53.957210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 966/1938] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:53.960961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a9b8-f160-4adf-9dfd-655c0ca2d0d7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.010778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3f4c-55a8-4725-8223-3177009878d5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.015299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.015905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.016180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.016443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.017077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.019009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.053449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 973/1939] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:54.053636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a9b8-f160-4adf-9dfd-655c0ca2d0d7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.055038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.061084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:54.125436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc60f7-5c9f-431d-a0e2-815cb3366520 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.127386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.128127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.128413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.128686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.129361 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.131272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.133033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.133669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.133945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.134217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.137391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.139439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.165189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 974/1940] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:54 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:54.169180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 967/1941] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:53 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:54.170828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.170958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.181576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1feaa2-0f05-454d-af96-55d040bbe2cf admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.184040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:54.250813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bebf5-af84-493f-b090-94fd2e077f75 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.255546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.256148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.256422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.256694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.258012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.260017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.264293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.264536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.264810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.265221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.265836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.267566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.280546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 975/1942] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:54.282187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 968/1943] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:54 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:54.284515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.286042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.294511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7524-8ada-4423-bec7-c82b65867403 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.299367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.300229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.300379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.300625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.301413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.302984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.306005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9994beb-a1d5-4b76-8466-b51cd8770526 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.310976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.311574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.311844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.312110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.313073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.314675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.320016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 969/1944] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:54.323617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.329676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 976/1945] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:54.333579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.334242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761da782-8822-42fd-9570-e543add8c86d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.341018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5a8d9-44b1-40f5-bd4a-e4c66fac4c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.341724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a8d9-44b1-40f5-bd4a-e4c66fac4c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.342115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a8d9-44b1-40f5-bd4a-e4c66fac4c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.342398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a8d9-44b1-40f5-bd4a-e4c66fac4c4b admin admin] PATH_INFO: `/v3/projects/3e2e27404ce04e5d85d127252474b242/users/ae55a809cba64dd78ec8c1e9f54ee5e6/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.346156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8f91-a9e4-454d-aff4-a87090b66f04 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.351827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.352569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.352909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.353228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] PATH_INFO: `/v3/projects/cebb261d947949a9a26f16133700d7d6/users/01e29ef071614ccea80bbd2de1802521/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.361321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5a8d9-44b1-40f5-bd4a-e4c66fac4c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2e27404ce04e5d85d127252474b242, user_id=ae55a809cba64dd78ec8c1e9f54ee5e6, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.364666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5a8d9-44b1-40f5-bd4a-e4c66fac4c4b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.382219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebb261d947949a9a26f16133700d7d6, user_id=01e29ef071614ccea80bbd2de1802521, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.384864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.400134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 970/1946] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:54 2022] PUT /identity/v3/projects/3e2e27404ce04e5d85d127252474b242/users/ae55a809cba64dd78ec8c1e9f54ee5e6/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:54.411153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614afb3c-0d69-43db-a950-6ba12e5f3fca None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.411485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614afb3c-0d69-43db-a950-6ba12e5f3fca None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.411887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614afb3c-0d69-43db-a950-6ba12e5f3fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.416719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 977/1947] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:54 2022] PUT /identity/v3/projects/cebb261d947949a9a26f16133700d7d6/users/01e29ef071614ccea80bbd2de1802521/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:56:54.420174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.448242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-614afb3c-0d69-43db-a950-6ba12e5f3fca None None] MFA Rules not processed for user `ae55a809cba64dd78ec8c1e9f54ee5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:54.449489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-614afb3c-0d69-43db-a950-6ba12e5f3fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:54.520350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:54.528774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff629870-eac9-4edd-b0c8-30e69f522ba3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.540316 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 971/1948] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:56:54.540525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.540525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.540525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.540525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.540843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.540843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.540981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614afb3c-0d69-43db-a950-6ba12e5f3fca None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.554646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 978/1949] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:56:54.554830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614afb3c-0d69-43db-a950-6ba12e5f3fca None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.556179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.559385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.561259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.561591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.562160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.562863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.564922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.571953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213bc87-3500-4115-89b7-2d40bc6588dd admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.584295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4be109-251d-4906-98c4-d46d43617c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.585587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4be109-251d-4906-98c4-d46d43617c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.585914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4be109-251d-4906-98c4-d46d43617c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.586190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4be109-251d-4906-98c4-d46d43617c3c admin admin] PATH_INFO: `/v3/projects/cebb261d947949a9a26f16133700d7d6/users/01e29ef071614ccea80bbd2de1802521/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.588096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4be109-251d-4906-98c4-d46d43617c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebb261d947949a9a26f16133700d7d6, user_id=01e29ef071614ccea80bbd2de1802521, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.590837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4be109-251d-4906-98c4-d46d43617c3c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.599636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 972/1950] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:56:54 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:56:54.602065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 979/1951] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:54 2022] PUT /identity/v3/projects/cebb261d947949a9a26f16133700d7d6/users/01e29ef071614ccea80bbd2de1802521/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:54.603634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.612274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.612587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.612885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.639666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:54.641872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] MFA Rules not processed for user `01e29ef071614ccea80bbd2de1802521`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:54.643123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:54.682874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d34e-7962-489c-ae35-487aceaa5b11 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.688180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.688789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.689055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.689361 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.690001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.691904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.716290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 973/1952] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:56:54 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:56:54.720480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.732465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41046cd9-39c1-4a50-8382-b32c2b21f101 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.734920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 980/1953] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:54.739438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.739438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.739438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.739438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.740015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.743310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.747678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.749591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:54.757770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 974/1954] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:54.760853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.775313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780b2b5-8916-4730-b3d9-d0599b9d1bda admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.780354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.781090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.781437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.781707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] PATH_INFO: `/v3/projects/ec70381f2861417da331185ce9523f64/users/46bdeb402bf4475fa63d9969067bfd39/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.804401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec70381f2861417da331185ce9523f64, user_id=46bdeb402bf4475fa63d9969067bfd39, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.808149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.815735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4880f9-c2f9-4abf-87ba-6854323c7548 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.826361 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 975/1955] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:54 2022] PUT /identity/v3/projects/ec70381f2861417da331185ce9523f64/users/46bdeb402bf4475fa63d9969067bfd39/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:54.830327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.873766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.874830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.875116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.875391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.906075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e6e28-52d7-448a-a03e-5578d0a04128 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.913955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.914786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.915155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.915498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.916285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.918021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.933165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:54.933408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 976/1956] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:56:54.938059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:54.948971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e778-97e7-4676-9fdc-842354a65205 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:54.953803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07869fc2-1809-4ab9-a69b-89be6215a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:54.954461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07869fc2-1809-4ab9-a69b-89be6215a4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.954933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07869fc2-1809-4ab9-a69b-89be6215a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.955042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07869fc2-1809-4ab9-a69b-89be6215a4eb admin admin] PATH_INFO: `/v3/projects/ec70381f2861417da331185ce9523f64/users/46bdeb402bf4475fa63d9969067bfd39/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:54.957068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07869fc2-1809-4ab9-a69b-89be6215a4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec70381f2861417da331185ce9523f64, user_id=46bdeb402bf4475fa63d9969067bfd39, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.960540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07869fc2-1809-4ab9-a69b-89be6215a4eb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.968735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:54.970271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:54.977253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 977/1957] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:56:54 2022] PUT /identity/v3/projects/ec70381f2861417da331185ce9523f64/users/46bdeb402bf4475fa63d9969067bfd39/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:56:54.981534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 981/1958] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:54.985086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:54.985949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:54.986457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:55.024106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] MFA Rules not processed for user `46bdeb402bf4475fa63d9969067bfd39`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:56:55.025582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:55.104080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:55.124558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb41503-308c-42ee-a0bb-ba54aee93c1f service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:55.157831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:55.173749 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 978/1959] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:56:55.186501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:55.188015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:56:55.235316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:55.235927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:55.236199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:55.236465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:55.287584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf0d5-cf3c-48f1-80dd-9d9c885629a5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:55.292805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:55.293527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:55.293781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:55.294053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:55.307985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:55.309951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:55.336800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 979/1960] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:55.412665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:55.415806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:55.428005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 982/1961] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:56:56.049721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:56:56.058703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ef3a-c2cc-4c79-8021-c118ab64f756 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:56:56.062550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:56:56.063150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:56:56.063425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:56:56.063692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:56:56.119931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:56:56.121398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:56:56.130210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 980/1962] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:56:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:00.326247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:00.334727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5e345-afa5-43b2-b275-810f40ad02b2 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:00.338730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:00.339336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:00.339612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:00.340007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:00.420093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:00.421982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:00.433919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 983/1963] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:02.853411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:02.885776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:02.919097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:02.956745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c54f3f-2e9d-4fa3-af3a-e600dfe5d59c service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:02.963167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:02.963753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:02.964099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:02.964406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] PATH_INFO: `/v3/users/eecd58191c1f4fd69752ef3794141b63` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:02.965953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eecd58191c1f4fd69752ef3794141b63)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:02.968490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:02.982675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040b729-5189-4245-b498-c02608ec8246 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:02.989817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:02.990624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:02.991120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:02.992251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] PATH_INFO: `/v3/users/739b5279134347e98a476edb1f622fda` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:02.994079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=739b5279134347e98a476edb1f622fda)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:02.996521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:03.044735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:03.060608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eecd58191c1f4fd69752ef3794141b63'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.075307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eecd58191c1f4fd69752ef3794141b63'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.076858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eecd58191c1f4fd69752ef3794141b63'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.096949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739b5279134347e98a476edb1f622fda'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.106611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eecd58191c1f4fd69752ef3794141b63'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.118442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739b5279134347e98a476edb1f622fda'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.121699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5d90cb66-bfd5-4144-8794-529633ebf343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eecd58191c1f4fd69752ef3794141b63'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.127442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739b5279134347e98a476edb1f622fda'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.129195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739b5279134347e98a476edb1f622fda'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.130806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 981/1964] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:02 2022] DELETE /identity/v3/users/eecd58191c1f4fd69752ef3794141b63 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:03.135320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:03.135440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:03.136218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:03.139288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-2dab142d-4cd3-47b7-a911-91ab9877fd23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739b5279134347e98a476edb1f622fda'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:03.146014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 984/1965] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:02 2022] DELETE /identity/v3/users/739b5279134347e98a476edb1f622fda => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:03.150908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:03.151186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:03.151464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:03.160328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:03.161620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:03.178033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:03.180621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:03.239613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 982/1966] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:03.253135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:03.258593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:03.268528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 985/1967] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:03.281631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:03.283498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:03.346233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf4584-a80a-46bb-8845-b9f2e8747b4d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:03.354787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:03.356061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:03.357359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:03.358323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:03.370918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:03.373065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:03.388230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 983/1968] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:03.395104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:03.440285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f29a2-8290-401d-b2af-f57c46549a09 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:03.448348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:03.449052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:03.449504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:03.449931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:03.461788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:03.463856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:03.477085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 986/1969] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:03.999246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:04.000757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:04.025010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79e2d8-cf6c-4007-b315-54036f13be85 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:04.034585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:04.035373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:04.036590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:04.037005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] PATH_INFO: `/v3/projects/9fb4cc5f336c4ce39566406b0678153d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:04.039416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb4cc5f336c4ce39566406b0678153d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:04.042696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:04.082163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:04.083755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:04.107893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805567-acfe-4b6a-85bb-8b7b1c0855a9 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:04.114137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:04.114977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:04.115355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:04.115768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] PATH_INFO: `/v3/projects/7e08bc1900c042f1be1f590968be40ce` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:04.118290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e08bc1900c042f1be1f590968be40ce)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:04.121378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:04.149021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb4cc5f336c4ce39566406b0678153d', 'request_id': 'req-07f98324-ec7f-4e1c-969f-b57bdd24997f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.152268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:04.160525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb4cc5f336c4ce39566406b0678153d', 'request_id': 'req-07f98324-ec7f-4e1c-969f-b57bdd24997f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.173330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb4cc5f336c4ce39566406b0678153d', 'request_id': 'req-07f98324-ec7f-4e1c-969f-b57bdd24997f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.198912 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] The token cache is being invalidate because project 9fb4cc5f336c4ce39566406b0678153d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:04.199580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.200322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.202346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 984/1970] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:03 2022] DELETE /identity/v3/projects/9fb4cc5f336c4ce39566406b0678153d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:04.217249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:04.217249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:04.237293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e08bc1900c042f1be1f590968be40ce', 'request_id': 'req-825252e1-c6cc-4cc7-9f05-fe22e1f50698'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.250107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e08bc1900c042f1be1f590968be40ce', 'request_id': 'req-825252e1-c6cc-4cc7-9f05-fe22e1f50698'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.261848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e08bc1900c042f1be1f590968be40ce', 'request_id': 'req-825252e1-c6cc-4cc7-9f05-fe22e1f50698'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.278455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] The token cache is being invalidate because project 7e08bc1900c042f1be1f590968be40ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:04.278790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.279672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.284327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 987/1971] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:04 2022] DELETE /identity/v3/projects/7e08bc1900c042f1be1f590968be40ce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:04.298629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:04.301199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:04.324756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f98324-ec7f-4e1c-969f-b57bdd24997f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:04.401222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825252e1-c6cc-4cc7-9f05-fe22e1f50698 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:04.405932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:04.406669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:04.406948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:04.407223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] PATH_INFO: `/v3/users/ae55a809cba64dd78ec8c1e9f54ee5e6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:04.408163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:04.408374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae55a809cba64dd78ec8c1e9f54ee5e6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:04.408848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:04.409131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:04.409454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] PATH_INFO: `/v3/users/01e29ef071614ccea80bbd2de1802521` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:04.410314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:04.410611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e29ef071614ccea80bbd2de1802521)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:04.413042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:04.470133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e29ef071614ccea80bbd2de1802521'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.471851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae55a809cba64dd78ec8c1e9f54ee5e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.481557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e29ef071614ccea80bbd2de1802521'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.482572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e29ef071614ccea80bbd2de1802521'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.510874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae55a809cba64dd78ec8c1e9f54ee5e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.513053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e29ef071614ccea80bbd2de1802521'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.515976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:04.520521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae55a809cba64dd78ec8c1e9f54ee5e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.521948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae55a809cba64dd78ec8c1e9f54ee5e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.532365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae55a809cba64dd78ec8c1e9f54ee5e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.532555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e29ef071614ccea80bbd2de1802521'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:04.541838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 988/1972] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:04 2022] DELETE /identity/v3/users/ae55a809cba64dd78ec8c1e9f54ee5e6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:04.542457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 985/1973] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:04 2022] DELETE /identity/v3/users/01e29ef071614ccea80bbd2de1802521 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:04.654063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:04.655812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:04.806344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf16c0-4e69-4349-b1b0-bf771f5ae2ff admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:04.933039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:04.934288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:04.934849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:04.934996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] PATH_INFO: `/v3/users/de2391839754486e98198cdbaca6e1c1` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:04.937595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2391839754486e98198cdbaca6e1c1)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:04.940259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:05.045337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:05.047473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:05.048707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2391839754486e98198cdbaca6e1c1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.065965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e8e17-5330-4734-8eee-19e668836f08 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:05.067568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2391839754486e98198cdbaca6e1c1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.080003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2391839754486e98198cdbaca6e1c1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.080120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:05.080873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:05.080983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:05.081292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] PATH_INFO: `/v3/projects/3e2e27404ce04e5d85d127252474b242` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:05.082554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2e27404ce04e5d85d127252474b242)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:05.083066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2391839754486e98198cdbaca6e1c1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.084480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:05.087146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:05.117044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b4e27d1-dc43-43d1-b071-77dd80bb53b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2391839754486e98198cdbaca6e1c1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.128487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 989/1974] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:04 2022] DELETE /identity/v3/users/de2391839754486e98198cdbaca6e1c1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:05.157076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:05.157555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:05.158954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:05.203886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2e27404ce04e5d85d127252474b242', 'request_id': 'req-552e0d27-8169-4b4d-a2fa-1228b61b9cab'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.211952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:05.214582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:05.217113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2e27404ce04e5d85d127252474b242', 'request_id': 'req-552e0d27-8169-4b4d-a2fa-1228b61b9cab'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.234141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:05.242220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2e27404ce04e5d85d127252474b242', 'request_id': 'req-552e0d27-8169-4b4d-a2fa-1228b61b9cab'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.265951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] The token cache is being invalidate because project 3e2e27404ce04e5d85d127252474b242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:05.266436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.270800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.272840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 986/1975] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:05 2022] DELETE /identity/v3/projects/3e2e27404ce04e5d85d127252474b242 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:05.276802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:05.278234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:05.330921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 990/1976] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:05.344255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:05.346730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:05.387499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e0d27-8169-4b4d-a2fa-1228b61b9cab admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:05.393577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:05.394602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:05.394977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:05.395344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] PATH_INFO: `/v3/users/46bdeb402bf4475fa63d9969067bfd39` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:05.396600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bdeb402bf4475fa63d9969067bfd39)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:05.399699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:05.489181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dd737-8a1b-4c61-8338-8e8bff2775fe None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:05.495275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:05.495898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:05.496054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bdeb402bf4475fa63d9969067bfd39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.496163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:05.497094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:05.513618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:05.514938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bdeb402bf4475fa63d9969067bfd39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.516475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:05.527015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bdeb402bf4475fa63d9969067bfd39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.540293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 991/1977] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:05.541882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:05.558246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:05.562581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bdeb402bf4475fa63d9969067bfd39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.573924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-26287a4e-2fa5-4cf8-a131-33430c79d955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bdeb402bf4475fa63d9969067bfd39'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.584506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55d450-c58a-4644-83a5-1fc80c7287aa service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:05.588862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 987/1978] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:05 2022] DELETE /identity/v3/users/46bdeb402bf4475fa63d9969067bfd39 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:05.594017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:05.594858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:05.595290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:05.595708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] PATH_INFO: `/v3/projects/cebb261d947949a9a26f16133700d7d6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:05.597451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebb261d947949a9a26f16133700d7d6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:05.599740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:05.777658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebb261d947949a9a26f16133700d7d6', 'request_id': 'req-422e30ab-3e4b-4f8d-97b0-63307116e819'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.793822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebb261d947949a9a26f16133700d7d6', 'request_id': 'req-422e30ab-3e4b-4f8d-97b0-63307116e819'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.804764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebb261d947949a9a26f16133700d7d6', 'request_id': 'req-422e30ab-3e4b-4f8d-97b0-63307116e819'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.820673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] The token cache is being invalidate because project cebb261d947949a9a26f16133700d7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:05.821075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.821895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-422e30ab-3e4b-4f8d-97b0-63307116e819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:05.824083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 992/1979] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:05 2022] DELETE /identity/v3/projects/cebb261d947949a9a26f16133700d7d6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:05.829206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c93ac-41c4-4eb9-9c8c-4f3a01c86a5d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:05.829690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c93ac-41c4-4eb9-9c8c-4f3a01c86a5d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:05.829867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c93ac-41c4-4eb9-9c8c-4f3a01c86a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:05.873664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8c5c93ac-41c4-4eb9-9c8c-4f3a01c86a5d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:05.874890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8c5c93ac-41c4-4eb9-9c8c-4f3a01c86a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:05.890319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:06.012430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 988/1980] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:06.020132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8cb6-b3b5-47b9-a858-cbc4ff3ed53d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.020489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8cb6-b3b5-47b9-a858-cbc4ff3ed53d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.020834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8cb6-b3b5-47b9-a858-cbc4ff3ed53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.045570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6aef8cb6-b3b5-47b9-a858-cbc4ff3ed53d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:06.047056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6aef8cb6-b3b5-47b9-a858-cbc4ff3ed53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:06.061692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 993/1981] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:06.062415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c93ac-41c4-4eb9-9c8c-4f3a01c86a5d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.078573 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c93ac-41c4-4eb9-9c8c-4f3a01c86a5d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.102207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.103417 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.103936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.108235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.110221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:06.111557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.113913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.132067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 989/1982] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:06.137230 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8cb6-b3b5-47b9-a858-cbc4ff3ed53d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.148179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8cb6-b3b5-47b9-a858-cbc4ff3ed53d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.154199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.154814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.155249 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.155525 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.156156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.159067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.194725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 994/1983] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:06.205266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.222421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a80fc-e32a-472c-81d7-a09bc5fb40a3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.227812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.229866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:06.249209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:06.315690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.316317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.316618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.317905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.318559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.321984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.326782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395170a2-2f87-4315-81ed-4cee2815697f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.335732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.336792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.337080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.337392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] PATH_INFO: `/v3/projects/a336181c11614caf8c6f416effb289ff` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.338565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a336181c11614caf8c6f416effb289ff)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.340482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.370788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 990/1984] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:06.375085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.391158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99e986-a885-4a11-87b1-cc9a72875dfb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.405733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a336181c11614caf8c6f416effb289ff', 'request_id': 'req-5dca4e13-e046-4387-8510-13348546c80e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:06.417268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a336181c11614caf8c6f416effb289ff', 'request_id': 'req-5dca4e13-e046-4387-8510-13348546c80e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:06.425105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a336181c11614caf8c6f416effb289ff', 'request_id': 'req-5dca4e13-e046-4387-8510-13348546c80e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:06.439459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] The token cache is being invalidate because project a336181c11614caf8c6f416effb289ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:06.439754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:06.440428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5dca4e13-e046-4387-8510-13348546c80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:06.442193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 995/1985] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:06 2022] DELETE /identity/v3/projects/a336181c11614caf8c6f416effb289ff => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:06.449548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4d66-14cd-493e-aa47-f4d5cfec6f6f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.449896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4d66-14cd-493e-aa47-f4d5cfec6f6f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.450176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4d66-14cd-493e-aa47-f4d5cfec6f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.466814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.468726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.468726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.468726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.468726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.470666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.483422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d8be4d66-14cd-493e-aa47-f4d5cfec6f6f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:06.485146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 991/1986] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:06.485348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d8be4d66-14cd-493e-aa47-f4d5cfec6f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:06.488704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.492842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:06.498133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 996/1987] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:06.506406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd5ad-eed5-4594-bc75-bfba4dceb1d0 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.506800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd5ad-eed5-4594-bc75-bfba4dceb1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.507179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd5ad-eed5-4594-bc75-bfba4dceb1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.520209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bdeb6-db9b-4011-a8be-4c8fa16184bd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.526085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.526951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.528075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.528075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.528488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.530012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.530546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-123fd5ad-eed5-4594-bc75-bfba4dceb1d0 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:06.532198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-123fd5ad-eed5-4594-bc75-bfba4dceb1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:06.541197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 997/1988] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:06.543191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 992/1989] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:06.545775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd5ad-eed5-4594-bc75-bfba4dceb1d0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.547009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.560816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd5ad-eed5-4594-bc75-bfba4dceb1d0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.563445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb7f3-e316-46d1-8454-b96950d2d1bb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.567614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.568506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.568822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.568951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5edd48-5aab-44bc-94a8-9afbc530a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.569233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.570096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd48-5aab-44bc-94a8-9afbc530a46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.570483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:06.570596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd48-5aab-44bc-94a8-9afbc530a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.570915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.571025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd48-5aab-44bc-94a8-9afbc530a46f admin admin] PATH_INFO: `/v3/projects/ec9a6b1f163140328919d07c15733836/users/8b7f57f7b98242589a6ecfa4899fcb5e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.574000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.581050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:06.588485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 998/1990] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:06.592163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5edd48-5aab-44bc-94a8-9afbc530a46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9a6b1f163140328919d07c15733836, user_id=8b7f57f7b98242589a6ecfa4899fcb5e, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.593415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.595049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5edd48-5aab-44bc-94a8-9afbc530a46f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.606324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944449-3a25-46fc-989d-dd02b5155389 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.621188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 993/1991] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:06 2022] PUT /identity/v3/projects/ec9a6b1f163140328919d07c15733836/users/8b7f57f7b98242589a6ecfa4899fcb5e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:06.628473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23beec-7062-4298-9fb8-bca41bb345d0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.628940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23beec-7062-4298-9fb8-bca41bb345d0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.629242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23beec-7062-4298-9fb8-bca41bb345d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.665938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2a23beec-7062-4298-9fb8-bca41bb345d0 None None] MFA Rules not processed for user `8b7f57f7b98242589a6ecfa4899fcb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:06.667254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2a23beec-7062-4298-9fb8-bca41bb345d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:06.692397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.693019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.693328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.693658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.694840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.697178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.726848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:06.736195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 999/1992] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:06.740174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.770314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 994/1993] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:06.775155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23beec-7062-4298-9fb8-bca41bb345d0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.791101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23beec-7062-4298-9fb8-bca41bb345d0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.839028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ad84-6642-448c-a258-aec91e819b8c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.844532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.845804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.846089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.846370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.847007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.848924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.898689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1000/1994] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:06.899900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:06.902849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:06.924963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.926478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.927483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.928040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.929841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.930959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880880a-b94d-48ba-8150-59268cb9afd0 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:06.932838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.937047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:06.937793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:06.938148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:06.938405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] PATH_INFO: `/v3/projects/ec70381f2861417da331185ce9523f64` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:06.939676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec70381f2861417da331185ce9523f64)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:06.941713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:06.970818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 995/1995] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:06 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:06.970818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.001130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec70381f2861417da331185ce9523f64', 'request_id': 'req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:07.010612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec70381f2861417da331185ce9523f64', 'request_id': 'req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:07.038639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec70381f2861417da331185ce9523f64', 'request_id': 'req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:07.048377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b2f6e-8520-4c73-92d1-7c95130d0a2c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.055205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:07.055966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] The token cache is being invalidate because project ec70381f2861417da331185ce9523f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:07.055966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:07.056878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:07.059159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1001/1996] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:06 2022] DELETE /identity/v3/projects/ec70381f2861417da331185ce9523f64 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:07.060863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.062509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:07.125397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d757b8-31e4-42ca-a178-658ce55903a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.126041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d757b8-31e4-42ca-a178-658ce55903a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.126321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d757b8-31e4-42ca-a178-658ce55903a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.126611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d757b8-31e4-42ca-a178-658ce55903a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.127240 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d757b8-31e4-42ca-a178-658ce55903a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.129190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d757b8-31e4-42ca-a178-658ce55903a1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.138919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4161e7b-adba-4f7a-ae37-9f1399bf9d24 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.142718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 996/1997] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:07.142718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.142718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.142718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.150459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb87bb-4f4e-4f09-8146-5eead85c1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.151081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb87bb-4f4e-4f09-8146-5eead85c1a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.151365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb87bb-4f4e-4f09-8146-5eead85c1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.151640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb87bb-4f4e-4f09-8146-5eead85c1a9d admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.152280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb87bb-4f4e-4f09-8146-5eead85c1a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.154244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb87bb-4f4e-4f09-8146-5eead85c1a9d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.162313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:07.164442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:07.180334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 997/1998] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:07.180334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.181578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:07.188374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1002/1999] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:07 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:07.188374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa77640-c6ac-44fe-8c74-cb8dd6e5f291 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.188374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa77640-c6ac-44fe-8c74-cb8dd6e5f291 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.188374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa77640-c6ac-44fe-8c74-cb8dd6e5f291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.196697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:07.199258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3a614-de93-4e7d-83e2-5b06f1e9c68b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.205408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.206440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.207020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.207329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.208061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.210371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.213418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3fa77640-c6ac-44fe-8c74-cb8dd6e5f291 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:07.214748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3fa77640-c6ac-44fe-8c74-cb8dd6e5f291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:07.224830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 998/2000] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:07.224830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.227150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1003/2001] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:07.230121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa77640-c6ac-44fe-8c74-cb8dd6e5f291 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.236413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12e9f-b62c-4abd-9e61-95d3a2d6486f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.241470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa77640-c6ac-44fe-8c74-cb8dd6e5f291 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.241997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.242947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.243223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.243498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.244315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.245939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.247050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.247897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.248554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.248834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] PATH_INFO: `/v3/projects/abfc066cc5d84042b109b5687ea34833/users/cfbdbd55271f4b7e9d0700179d42a7b7/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.258414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 999/2002] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:07.262664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.266205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfc066cc5d84042b109b5687ea34833, user_id=cfbdbd55271f4b7e9d0700179d42a7b7, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.268902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.275336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea410c-d034-47c1-b385-c2d8b3599ed4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.280711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9336b-035c-4dc3-b948-6ab9a6b0d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.281343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9336b-035c-4dc3-b948-6ab9a6b0d6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.281670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9336b-035c-4dc3-b948-6ab9a6b0d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.282242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9336b-035c-4dc3-b948-6ab9a6b0d6d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.282944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9336b-035c-4dc3-b948-6ab9a6b0d6d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:07.283250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9336b-035c-4dc3-b948-6ab9a6b0d6d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.283774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1004/2003] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:07 2022] PUT /identity/v3/projects/abfc066cc5d84042b109b5687ea34833/users/cfbdbd55271f4b7e9d0700179d42a7b7/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:07.285410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9336b-035c-4dc3-b948-6ab9a6b0d6d8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.294236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.301317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1000/2004] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:07.306406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a2f0-a7d7-47b0-af9f-100244ae5428 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.306691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a2f0-a7d7-47b0-af9f-100244ae5428 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.307429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a2f0-a7d7-47b0-af9f-100244ae5428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.339947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6af5a2f0-a7d7-47b0-af9f-100244ae5428 None None] MFA Rules not processed for user `cfbdbd55271f4b7e9d0700179d42a7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:07.341180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6af5a2f0-a7d7-47b0-af9f-100244ae5428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:07.385454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4dd5b-ea7e-48f6-816e-d4a0229eca89 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.391543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.392632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.393408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.393879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] PATH_INFO: `/v3/projects/dfbe8b916648485482463a4c5e6d2b07/users/e01e205132ea4a81bf6a8be76896b934/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.415651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbe8b916648485482463a4c5e6d2b07, user_id=e01e205132ea4a81bf6a8be76896b934, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.421035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.431077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1001/2005] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:07.432706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5a2f0-a7d7-47b0-af9f-100244ae5428 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.442219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1005/2006] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:07 2022] PUT /identity/v3/projects/dfbe8b916648485482463a4c5e6d2b07/users/e01e205132ea4a81bf6a8be76896b934/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:07.446018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.447822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:07.447946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5a2f0-a7d7-47b0-af9f-100244ae5428 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.504244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:07.519475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.520612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.521180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.521469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.522232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.524473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.545919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff04b-0df4-4776-a7ae-6b3f4fe16083 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.551145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.551834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.552236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.552487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.569122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1002/2007] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:07 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:07.569122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.646454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.648809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.664202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1006/2008] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:07.665116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.684524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279caa3c-f636-4409-9356-d6c39fc79133 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.703906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:07.727400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e8e84-a283-4ba2-9326-7472477a7d63 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.734695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.735728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.736315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.736685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.737504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.739843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.753705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1003/2009] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:07.759506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.770378 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da741f7-2fc1-4224-b1e3-50fccc5eee21 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.776686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3adc4-ce80-486f-a4b3-b708572bdf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.777704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3adc4-ce80-486f-a4b3-b708572bdf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.778135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3adc4-ce80-486f-a4b3-b708572bdf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.778563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3adc4-ce80-486f-a4b3-b708572bdf28 admin admin] PATH_INFO: `/v3/projects/dfbe8b916648485482463a4c5e6d2b07/users/e01e205132ea4a81bf6a8be76896b934/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.781675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3adc4-ce80-486f-a4b3-b708572bdf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbe8b916648485482463a4c5e6d2b07, user_id=e01e205132ea4a81bf6a8be76896b934, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.784579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3adc4-ce80-486f-a4b3-b708572bdf28 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.787516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.788501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.789489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.789849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.791104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.794194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.800620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1004/2010] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:07 2022] PUT /identity/v3/projects/dfbe8b916648485482463a4c5e6d2b07/users/e01e205132ea4a81bf6a8be76896b934/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:07.812931 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4deb-1c60-4c6b-beea-25c060935e0e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.813380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4deb-1c60-4c6b-beea-25c060935e0e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.813910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4deb-1c60-4c6b-beea-25c060935e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.835142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1007/2011] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:07 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:07.844730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:07.860217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae829d3-99b2-484b-9cc2-b4dc449b2441 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:07.875547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e2ed4deb-1c60-4c6b-beea-25c060935e0e None None] MFA Rules not processed for user `e01e205132ea4a81bf6a8be76896b934`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:07.878980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e2ed4deb-1c60-4c6b-beea-25c060935e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:07.964518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:07.965176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:07.965455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:07.965734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:07.968245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:07.969931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:07.997608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1005/2012] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:07.999349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4deb-1c60-4c6b-beea-25c060935e0e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.002224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1008/2013] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:08.013668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.015886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:08.021571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4deb-1c60-4c6b-beea-25c060935e0e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.034330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.035383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.035970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.036411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.037499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.042698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.057900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1006/2014] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:08.061845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.082856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ae55-a68a-43e7-9968-29932384d8dc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.106236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831202a-db98-4f7d-ae2b-7b7159b2504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.116806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831202a-db98-4f7d-ae2b-7b7159b2504c admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.118454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831202a-db98-4f7d-ae2b-7b7159b2504c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.118839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831202a-db98-4f7d-ae2b-7b7159b2504c admin admin] PATH_INFO: `/v3/projects/5a4e904bf5bb41c7b55d7d841847a881/users/efc7cdd1407649acaea81420fa6674ed/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.161737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f891-d6bf-4a20-9a70-0b1da733f31a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.162200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831202a-db98-4f7d-ae2b-7b7159b2504c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4e904bf5bb41c7b55d7d841847a881, user_id=efc7cdd1407649acaea81420fa6674ed, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.165310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831202a-db98-4f7d-ae2b-7b7159b2504c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.172247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.173111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.173664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.174058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.176770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:08.184700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1007/2015] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:08 2022] PUT /identity/v3/projects/5a4e904bf5bb41c7b55d7d841847a881/users/efc7cdd1407649acaea81420fa6674ed/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:08.196278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6918e-1153-4e42-a2d2-f1c91a918f1a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.196664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6918e-1153-4e42-a2d2-f1c91a918f1a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.197713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6918e-1153-4e42-a2d2-f1c91a918f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.248695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:08.250804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:08.271190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.273425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.274194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-60b6918e-1153-4e42-a2d2-f1c91a918f1a None None] MFA Rules not processed for user `efc7cdd1407649acaea81420fa6674ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:08.277227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-60b6918e-1153-4e42-a2d2-f1c91a918f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:08.289749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1009/2016] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:08.367921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1008/2017] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:08.372735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.385208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d933bd-ce36-4d1f-a5f6-b61e07dedaaa service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.498967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.499246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.500221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.500221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.500606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.502949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.555551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1010/2018] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:08 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:08.556537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6918e-1153-4e42-a2d2-f1c91a918f1a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.591575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6918e-1153-4e42-a2d2-f1c91a918f1a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.709450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.710206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.710482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.710756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.711407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.713453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.748097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1009/2019] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:08 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:08.751716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.766476 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e4542-01f3-4f7d-82b5-55815c1ad447 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.771680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.772415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.772770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.773117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.773872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.776500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.788856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1011/2020] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:08.793431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.803364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8c4f7-db51-46fb-9f8f-a941811ec927 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.808767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.809454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.809736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.810010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] PATH_INFO: `/v3/projects/fa029e2f1f2243dfb7aebe726b365c1b/users/22914401d4894691b1746dc1bbb98e28/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.825943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa029e2f1f2243dfb7aebe726b365c1b, user_id=22914401d4894691b1746dc1bbb98e28, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.828702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.843528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1010/2021] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:08 2022] PUT /identity/v3/projects/fa029e2f1f2243dfb7aebe726b365c1b/users/22914401d4894691b1746dc1bbb98e28/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:08.847850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.873436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e42cc-d7b1-49fd-873e-6a1c6e5c94d9 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.945116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278da1a-6bb3-4001-a33f-c4a8a0021f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.945873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278da1a-6bb3-4001-a33f-c4a8a0021f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.946152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278da1a-6bb3-4001-a33f-c4a8a0021f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.946421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278da1a-6bb3-4001-a33f-c4a8a0021f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.947067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278da1a-6bb3-4001-a33f-c4a8a0021f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.948648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278da1a-6bb3-4001-a33f-c4a8a0021f39 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:08.961780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1012/2022] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:08.963268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:08.974381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8c980-c72c-4617-838d-e0776d5ae11f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:08.980158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:08.980815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:08.981090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:08.981390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] PATH_INFO: `/v3/projects/fa029e2f1f2243dfb7aebe726b365c1b/users/22914401d4894691b1746dc1bbb98e28/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:08.984272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa029e2f1f2243dfb7aebe726b365c1b, user_id=22914401d4894691b1746dc1bbb98e28, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:08.986491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:09.000136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1011/2023] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:08 2022] PUT /identity/v3/projects/fa029e2f1f2243dfb7aebe726b365c1b/users/22914401d4894691b1746dc1bbb98e28/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:09.012354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411a38-b6f8-4200-92be-2c360d4044e0 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:09.012611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411a38-b6f8-4200-92be-2c360d4044e0 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:09.012699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411a38-b6f8-4200-92be-2c360d4044e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:09.045164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-04411a38-b6f8-4200-92be-2c360d4044e0 None None] MFA Rules not processed for user `22914401d4894691b1746dc1bbb98e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:09.046500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-04411a38-b6f8-4200-92be-2c360d4044e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:09.107085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:09.134464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1013/2024] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:09.153865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:09.229988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d6f8-9a1e-4f70-a10f-2017ffdc9dd8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:09.235237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:09.236722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:09.236998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:09.237375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:09.244078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:09.314032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:09.315837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:09.342042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1012/2025] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:09.811391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411a38-b6f8-4200-92be-2c360d4044e0 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:09.824698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411a38-b6f8-4200-92be-2c360d4044e0 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:09.830697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2970e-3b98-404c-a8e4-dd3f678e9db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:09.831448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2970e-3b98-404c-a8e4-dd3f678e9db4 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:09.831915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2970e-3b98-404c-a8e4-dd3f678e9db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:09.832447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2970e-3b98-404c-a8e4-dd3f678e9db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:09.996408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2970e-3b98-404c-a8e4-dd3f678e9db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:09.997901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2970e-3b98-404c-a8e4-dd3f678e9db4 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:10.015649 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1014/2026] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:10.744244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:10.831699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0a27-bf18-45bf-9dae-545e352e0990 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:10.840270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:10.840929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:10.841232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:10.841500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] PATH_INFO: `/v3/users/cfbdbd55271f4b7e9d0700179d42a7b7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:10.842866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbdbd55271f4b7e9d0700179d42a7b7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:10.844857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:10.915703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbdbd55271f4b7e9d0700179d42a7b7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:10.924522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbdbd55271f4b7e9d0700179d42a7b7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:10.925282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbdbd55271f4b7e9d0700179d42a7b7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:10.939620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbdbd55271f4b7e9d0700179d42a7b7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:10.947176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbdbd55271f4b7e9d0700179d42a7b7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:10.953690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1013/2027] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:10 2022] DELETE /identity/v3/users/cfbdbd55271f4b7e9d0700179d42a7b7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:10.958204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:10.958671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:10.958776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:10.979599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:10.981659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:11.080425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1015/2028] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:11.095226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:11.096751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:11.152413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:11.191535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352700e7-c265-49be-a5ca-e4eae416bafa admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:11.196090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:11.196703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:11.196977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:11.197278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:11.208958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:11.211635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:11.223403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1014/2029] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:11.672260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:11.674668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:11.690782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d7fd-13db-40be-a696-34e02b6b0b97 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:11.707646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:11.708894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:11.709273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:11.709652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] PATH_INFO: `/v3/projects/abfc066cc5d84042b109b5687ea34833` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:11.711161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfc066cc5d84042b109b5687ea34833)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:11.713500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:11.788185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfc066cc5d84042b109b5687ea34833', 'request_id': 'req-fc4446b1-dfb9-4514-88ff-b2a69bc64785'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:11.797452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfc066cc5d84042b109b5687ea34833', 'request_id': 'req-fc4446b1-dfb9-4514-88ff-b2a69bc64785'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:11.804545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfc066cc5d84042b109b5687ea34833', 'request_id': 'req-fc4446b1-dfb9-4514-88ff-b2a69bc64785'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:11.817019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] The token cache is being invalidate because project abfc066cc5d84042b109b5687ea34833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:11.817521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:11.818410 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc4446b1-dfb9-4514-88ff-b2a69bc64785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:11.820620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1016/2030] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:11 2022] DELETE /identity/v3/projects/abfc066cc5d84042b109b5687ea34833 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:14.105424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:14.107243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:14.122001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23d6bb-6422-4807-8f5d-d896603b0aef service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:14.187174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:14.187807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:14.188086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:14.188359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] PATH_INFO: `/v3/users/8b7f57f7b98242589a6ecfa4899fcb5e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:14.189554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7f57f7b98242589a6ecfa4899fcb5e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:14.191628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:14.239995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7f57f7b98242589a6ecfa4899fcb5e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.248314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7f57f7b98242589a6ecfa4899fcb5e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.248975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7f57f7b98242589a6ecfa4899fcb5e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.262301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7f57f7b98242589a6ecfa4899fcb5e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.269452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7f57f7b98242589a6ecfa4899fcb5e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.275994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1015/2031] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:14 2022] DELETE /identity/v3/users/8b7f57f7b98242589a6ecfa4899fcb5e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:14.280859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:14.281384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:14.281513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:14.290464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:14.307418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:14.308750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:14.380235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1017/2032] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:14.393484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:14.394995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:14.468523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:14.472891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2014c2-25c0-4a1e-a187-0dbc16faafc4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:14.480140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:14.480978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:14.481293 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:14.481649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:14.492510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:14.494007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:14.504294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1016/2033] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:14.890005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:14.891567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:14.906380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074a07b-1bca-47f9-bf7b-630e32c35e68 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:14.911804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:14.912565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:14.913458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:14.914472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] PATH_INFO: `/v3/projects/ec9a6b1f163140328919d07c15733836` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:14.916754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9a6b1f163140328919d07c15733836)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:14.919036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:14.969985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9a6b1f163140328919d07c15733836', 'request_id': 'req-ad7ca667-d68e-430c-b764-e66f78f762cb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.978547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9a6b1f163140328919d07c15733836', 'request_id': 'req-ad7ca667-d68e-430c-b764-e66f78f762cb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.985212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9a6b1f163140328919d07c15733836', 'request_id': 'req-ad7ca667-d68e-430c-b764-e66f78f762cb'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.997361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] The token cache is being invalidate because project ec9a6b1f163140328919d07c15733836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:14.997654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.998317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:14.999851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1018/2034] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:14 2022] DELETE /identity/v3/projects/ec9a6b1f163140328919d07c15733836 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:15.003797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:15.014123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8cb89-84ff-4353-845d-821560848ffa service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:15.077779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:15.078418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:15.078823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:15.079103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] PATH_INFO: `/v3/users/e01e205132ea4a81bf6a8be76896b934` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:15.080239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01e205132ea4a81bf6a8be76896b934)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:15.082731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:15.157415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01e205132ea4a81bf6a8be76896b934'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.159017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:15.160479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:15.169644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01e205132ea4a81bf6a8be76896b934'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.170202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01e205132ea4a81bf6a8be76896b934'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.190864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01e205132ea4a81bf6a8be76896b934'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.208807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01e205132ea4a81bf6a8be76896b934'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.217492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1017/2035] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:15 2022] DELETE /identity/v3/users/e01e205132ea4a81bf6a8be76896b934 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:15.272736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ca667-d68e-430c-b764-e66f78f762cb admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:15.345084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:15.360950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767abfe0-9a74-4883-9378-4ab4e307d048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:15.361829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767abfe0-9a74-4883-9378-4ab4e307d048 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:15.362985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767abfe0-9a74-4883-9378-4ab4e307d048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:15.363264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767abfe0-9a74-4883-9378-4ab4e307d048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:15.365115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-767abfe0-9a74-4883-9378-4ab4e307d048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:15.471595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767abfe0-9a74-4883-9378-4ab4e307d048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:15.473230 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767abfe0-9a74-4883-9378-4ab4e307d048 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:15.487652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1019/2036] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:15.574993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:15.576689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:15.691972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5103c3a-fc83-4ede-9459-a26a3bf5a986 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:15.706926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:15.707857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:15.708324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:15.708791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] PATH_INFO: `/v3/projects/dfbe8b916648485482463a4c5e6d2b07` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:15.710244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbe8b916648485482463a4c5e6d2b07)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:15.712609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:15.729445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:15.781861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbe8b916648485482463a4c5e6d2b07', 'request_id': 'req-e572f3ff-d21a-4bec-81ef-18d27fd177e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.794469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbe8b916648485482463a4c5e6d2b07', 'request_id': 'req-e572f3ff-d21a-4bec-81ef-18d27fd177e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.806312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbe8b916648485482463a4c5e6d2b07', 'request_id': 'req-e572f3ff-d21a-4bec-81ef-18d27fd177e8'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.819419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] The token cache is being invalidate because project dfbe8b916648485482463a4c5e6d2b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:15.819818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.820683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e572f3ff-d21a-4bec-81ef-18d27fd177e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:15.822676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1018/2037] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:15 2022] DELETE /identity/v3/projects/dfbe8b916648485482463a4c5e6d2b07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:15.827262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8da6-7588-4514-aa04-a5ff9e5f650b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:15.827550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8da6-7588-4514-aa04-a5ff9e5f650b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:15.827823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8da6-7588-4514-aa04-a5ff9e5f650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:15.864100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-913d8da6-7588-4514-aa04-a5ff9e5f650b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:15.865380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-913d8da6-7588-4514-aa04-a5ff9e5f650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:15.955961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1020/2038] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:15.964599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e933c-c438-4bef-8e6e-38f9b3c8917b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:15.964895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e933c-c438-4bef-8e6e-38f9b3c8917b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:15.965211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e933c-c438-4bef-8e6e-38f9b3c8917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.007532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-069e933c-c438-4bef-8e6e-38f9b3c8917b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:16.009688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-069e933c-c438-4bef-8e6e-38f9b3c8917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:16.018994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1019/2039] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:16.024429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8da6-7588-4514-aa04-a5ff9e5f650b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.034705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8da6-7588-4514-aa04-a5ff9e5f650b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.040232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.040839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.041124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.041427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.042085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:16.042387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.043975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.056423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1021/2040] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:16.060876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e933c-c438-4bef-8e6e-38f9b3c8917b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.070144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e933c-c438-4bef-8e6e-38f9b3c8917b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.075262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.075863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.076141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.076415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.077068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.079090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.110992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1020/2041] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:16 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:16.112363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.122803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da654c-bbaf-40af-a44c-b44757743f85 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.179544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.180147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.180426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.180699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.181356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.183267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.205273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1022/2042] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:16 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:16.209423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.220092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdeeb17-2747-4901-84b6-aec444eb939f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.224981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.225708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.225987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.226256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.226901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.228542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.238744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1021/2043] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:16.242647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.252364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120ae9-b66d-479e-96f9-8ebb58ab028d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.257489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55fd98-f80b-44a5-808f-28241f35c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.258075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fd98-f80b-44a5-808f-28241f35c5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.258352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fd98-f80b-44a5-808f-28241f35c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.258618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fd98-f80b-44a5-808f-28241f35c5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.259252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55fd98-f80b-44a5-808f-28241f35c5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.260867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55fd98-f80b-44a5-808f-28241f35c5c8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.263074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:16.273786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1023/2044] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:16.277609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.288505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334f66-0969-4d31-a040-25c2fcbae815 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.293074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.293737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.294010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.294277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] PATH_INFO: `/v3/projects/ba4c98cc86b74580afad5c822822b155/users/9b7ad2d7b33a4d82bc5f317d70eb194f/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.309016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4c98cc86b74580afad5c822822b155, user_id=9b7ad2d7b33a4d82bc5f317d70eb194f, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.311652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.324675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1022/2045] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:16 2022] PUT /identity/v3/projects/ba4c98cc86b74580afad5c822822b155/users/9b7ad2d7b33a4d82bc5f317d70eb194f/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:16.337018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40caa4-ae48-4600-ac4a-9c94749ef99c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.337327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40caa4-ae48-4600-ac4a-9c94749ef99c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.337595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40caa4-ae48-4600-ac4a-9c94749ef99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.366366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1e40caa4-ae48-4600-ac4a-9c94749ef99c None None] MFA Rules not processed for user `9b7ad2d7b33a4d82bc5f317d70eb194f`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:16.367567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1e40caa4-ae48-4600-ac4a-9c94749ef99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:16.432294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1024/2046] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:16.436845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.502443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9f31-a8e2-459c-af96-e3a07a788083 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.508584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.509315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.509641 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.509943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.510640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.512808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.542400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1023/2047] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:16 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:16.546885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40caa4-ae48-4600-ac4a-9c94749ef99c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.558576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40caa4-ae48-4600-ac4a-9c94749ef99c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.623991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.624603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.624888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.625187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.625850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.627745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.651744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1025/2048] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:16 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:16.653456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.664274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42b376-a0ee-4638-bf12-9bc29a07bfb6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.668884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.669606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.669885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.670154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.670803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.672476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.685224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1024/2049] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:16.689833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.701459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0351bd-f233-4c43-b4e2-a27fa1e4189d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.706295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.706943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.707216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.707483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] PATH_INFO: `/v3/projects/4c01d8f424da490b91120e211f5fe443/users/6eb2df49d68e486fa9d22bb1fb09229a/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.723342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c01d8f424da490b91120e211f5fe443, user_id=6eb2df49d68e486fa9d22bb1fb09229a, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.726720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.739923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1026/2050] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:16 2022] PUT /identity/v3/projects/4c01d8f424da490b91120e211f5fe443/users/6eb2df49d68e486fa9d22bb1fb09229a/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:16.744562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.754635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0c6c2-0eb4-4ba1-9598-d2cbe9ad4422 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.764321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:16.818925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249070-c115-46dc-881a-421976249776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.820572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249070-c115-46dc-881a-421976249776 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.820926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249070-c115-46dc-881a-421976249776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.821111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249070-c115-46dc-881a-421976249776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.821786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249070-c115-46dc-881a-421976249776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.823377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249070-c115-46dc-881a-421976249776 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.837902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1025/2051] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:16.839306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.849937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935f398-783e-4063-a2eb-35e70caca126 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:16.854695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:16.855347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.855620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.855889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] PATH_INFO: `/v3/projects/4c01d8f424da490b91120e211f5fe443/users/6eb2df49d68e486fa9d22bb1fb09229a/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.857948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c01d8f424da490b91120e211f5fe443, user_id=6eb2df49d68e486fa9d22bb1fb09229a, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:16.861120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:16.873019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1027/2052] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:16 2022] PUT /identity/v3/projects/4c01d8f424da490b91120e211f5fe443/users/6eb2df49d68e486fa9d22bb1fb09229a/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:16.883441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7623d-fc3a-4923-b941-1e9ce2a1d4b0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:16.883726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7623d-fc3a-4923-b941-1e9ce2a1d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:16.883996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7623d-fc3a-4923-b941-1e9ce2a1d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:16.911980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6af7623d-fc3a-4923-b941-1e9ce2a1d4b0 None None] MFA Rules not processed for user `6eb2df49d68e486fa9d22bb1fb09229a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:16.913339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6af7623d-fc3a-4923-b941-1e9ce2a1d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:16.981803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1026/2053] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:16.994768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:16.996472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:17.057916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:17.078285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4303c9-9554-404b-8a6a-b04af04cf341 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:17.082205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:17.082809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:17.083087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:17.083373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:17.094605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:17.096152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:17.108342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1028/2054] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:17.556763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7623d-fc3a-4923-b941-1e9ce2a1d4b0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:17.567951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7623d-fc3a-4923-b941-1e9ce2a1d4b0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:17.577867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb2df49d68e486fa9d22bb1fb09229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c01d8f424da490b91120e211f5fe443', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:17.578582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:17.578967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:17.579321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:17.580377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:17.580809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:17.583049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:17.613161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1027/2055] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:17.617937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:17.628450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94751c1e-1061-4fc6-af82-a0a16c3450c7 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:17.637889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb2df49d68e486fa9d22bb1fb09229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c01d8f424da490b91120e211f5fe443', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:17.638524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:17.638802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:17.639073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:17.639702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:17.642336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:17.689550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1029/2056] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:17 2022] POST /identity/v3/projects => generated 354 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:17.691941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:17.710839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287eddf-5ea0-4367-9ccc-db5c1a870130 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:17.779582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb2df49d68e486fa9d22bb1fb09229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c01d8f424da490b91120e211f5fe443', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:17.780232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:17.780517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:17.780792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:17.781490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:17.781950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:17.783599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:17.802528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1028/2057] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:17.848208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:17.860109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e9173-6011-4448-8a47-cc774ca03cc4 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:17.864924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb2df49d68e486fa9d22bb1fb09229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c01d8f424da490b91120e211f5fe443', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:17.865588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:17.865929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:17.866245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] PATH_INFO: `/v3/projects/a8d68dcd06504dc1a4b6e29cd0e26c40` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:17.867350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8d68dcd06504dc1a4b6e29cd0e26c40)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:17.869278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:17.933386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d68dcd06504dc1a4b6e29cd0e26c40', 'request_id': 'req-962ed596-c501-4fc0-b940-010e60f68734'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:17.941481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d68dcd06504dc1a4b6e29cd0e26c40', 'request_id': 'req-962ed596-c501-4fc0-b940-010e60f68734'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:17.948460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d68dcd06504dc1a4b6e29cd0e26c40', 'request_id': 'req-962ed596-c501-4fc0-b940-010e60f68734'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:17.961532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] The token cache is being invalidate because project a8d68dcd06504dc1a4b6e29cd0e26c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:17.961977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:17.962754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-962ed596-c501-4fc0-b940-010e60f68734 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:17.964355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1030/2058] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:17 2022] DELETE /identity/v3/projects/a8d68dcd06504dc1a4b6e29cd0e26c40 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:18.191434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:18.193422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:18.208066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:18.264006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265a12a-3b3c-4a1b-a281-e9269d463930 tempest-VolumeQuotaClassesTest-711850411 tempest-VolumeQuotaClassesTest-711850411-project-admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:18.326841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:18.327508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:18.327841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:18.328176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] PATH_INFO: `/v3/users/9b7ad2d7b33a4d82bc5f317d70eb194f` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:18.329405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7ad2d7b33a4d82bc5f317d70eb194f)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:18.331540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:18.401204 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7ad2d7b33a4d82bc5f317d70eb194f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:18.409486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7ad2d7b33a4d82bc5f317d70eb194f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:18.410111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7ad2d7b33a4d82bc5f317d70eb194f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:18.425256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7ad2d7b33a4d82bc5f317d70eb194f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:18.432978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7ad2d7b33a4d82bc5f317d70eb194f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:18.439260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1029/2059] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:18 2022] DELETE /identity/v3/users/9b7ad2d7b33a4d82bc5f317d70eb194f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:18.443697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:18.444763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:18.445520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:18.465786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:18.467335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:18.556658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1031/2060] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:18.565425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:18.568333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:18.629614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:18.655214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41760a-a950-4e27-9f70-4701f1bb1819 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:18.665450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:18.666085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:18.666366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:18.666808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:18.677789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:18.679321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:18.698219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1030/2061] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:19.129918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:19.131469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:19.148726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1167-d0e3-490f-86d8-2b0dca1b0903 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:19.161421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:19.162077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:19.163564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:19.163564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] PATH_INFO: `/v3/projects/ba4c98cc86b74580afad5c822822b155` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:19.165281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4c98cc86b74580afad5c822822b155)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:19.167270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:19.235380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:19.251869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4c98cc86b74580afad5c822822b155', 'request_id': 'req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.271142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4c98cc86b74580afad5c822822b155', 'request_id': 'req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.285451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4c98cc86b74580afad5c822822b155', 'request_id': 'req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.309793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] The token cache is being invalidate because project ba4c98cc86b74580afad5c822822b155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:19.310093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.310797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.316686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1032/2062] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:19 2022] DELETE /identity/v3/projects/ba4c98cc86b74580afad5c822822b155 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:19.317073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:19.328254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b4143-e9a0-42a6-b560-a57b17777926 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:19.400149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:19.400794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:19.401071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:19.401371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] PATH_INFO: `/v3/users/6eb2df49d68e486fa9d22bb1fb09229a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:19.405380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb2df49d68e486fa9d22bb1fb09229a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:19.407926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:19.476724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb2df49d68e486fa9d22bb1fb09229a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.486121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb2df49d68e486fa9d22bb1fb09229a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.486975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb2df49d68e486fa9d22bb1fb09229a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.505896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb2df49d68e486fa9d22bb1fb09229a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.517926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-eaa4ca2b-1f06-44b9-b158-ca8356836db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb2df49d68e486fa9d22bb1fb09229a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:19.528577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1031/2063] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:19 2022] DELETE /identity/v3/users/6eb2df49d68e486fa9d22bb1fb09229a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:20.055532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:20.059586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:20.077596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52732-2338-44d1-9b0b-263d8b3f3ff1 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:20.153096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:20.153782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.153943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.154212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] PATH_INFO: `/v3/projects/4c01d8f424da490b91120e211f5fe443` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.155547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c01d8f424da490b91120e211f5fe443)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:20.158147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:20.240226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c01d8f424da490b91120e211f5fe443', 'request_id': 'req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.256882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c01d8f424da490b91120e211f5fe443', 'request_id': 'req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.265051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c01d8f424da490b91120e211f5fe443', 'request_id': 'req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.278344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] The token cache is being invalidate because project 4c01d8f424da490b91120e211f5fe443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:20.278752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.279411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc5b5b2d-8833-41e7-9e08-dca08b1bf8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.284155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1033/2064] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:20 2022] DELETE /identity/v3/projects/4c01d8f424da490b91120e211f5fe443 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:20.285964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a3e7-7736-45ea-988f-14c4c29de8e1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.286449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a3e7-7736-45ea-988f-14c4c29de8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.286542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a3e7-7736-45ea-988f-14c4c29de8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.308739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-64a8a3e7-7736-45ea-988f-14c4c29de8e1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:20.309973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-64a8a3e7-7736-45ea-988f-14c4c29de8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:20.374346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1032/2065] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:20.384615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb7bf-3077-49a9-925e-815500f5c5bc None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.384966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb7bf-3077-49a9-925e-815500f5c5bc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.385346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb7bf-3077-49a9-925e-815500f5c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.415499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-104bb7bf-3077-49a9-925e-815500f5c5bc None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:20.417070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-104bb7bf-3077-49a9-925e-815500f5c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:20.429711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1034/2066] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:20.434012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a3e7-7736-45ea-988f-14c4c29de8e1 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:20.438979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:20.445178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a3e7-7736-45ea-988f-14c4c29de8e1 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:20.451416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:20.452187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.452471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.452876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.453877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:20.454217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:20.456284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:20.469121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1033/2067] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:20.474811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bb7bf-3077-49a9-925e-815500f5c5bc None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:20.486456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bb7bf-3077-49a9-925e-815500f5c5bc None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:20.498003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:20.498946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.499500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.499913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.500805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:20.504025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:20.580314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1035/2068] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:20 2022] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:20.581084 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:20.600190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f894f-92cf-4ca2-8489-ef3c7d82d7be admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:20.634922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:20.636672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:20.692075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:20.738946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edc71c-e61d-4998-b8d3-37922f4ce0da admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:20.745060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:20.746259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.746687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.747104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] PATH_INFO: `/v3/users/efc7cdd1407649acaea81420fa6674ed` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.748491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc7cdd1407649acaea81420fa6674ed)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:20.750741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:20.750944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:20.751366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.751640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.751907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.752546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:20.755746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:20.821607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1034/2069] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:20 2022] POST /identity/v3/users => generated 280 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:20.825298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:20.841591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba682f-a7dd-4d6d-85f9-1788a26a6d33 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:20.843877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc7cdd1407649acaea81420fa6674ed'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.849795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:20.851134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.851807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.852478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.855217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:20.858792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:20.870007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc7cdd1407649acaea81420fa6674ed'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.883585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc7cdd1407649acaea81420fa6674ed'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.884752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc7cdd1407649acaea81420fa6674ed'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.891911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1035/2070] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:20.896652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:20.899326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-79c76b35-aac7-46fa-8d0e-f711650820a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc7cdd1407649acaea81420fa6674ed'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:20.900360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:20.911190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1036/2071] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:20 2022] DELETE /identity/v3/users/efc7cdd1407649acaea81420fa6674ed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:20.913736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:20.914760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:20.915302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:20.929941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e11e6-d15f-429f-9900-8245014a1b73 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:20.968283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:20.969862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.073514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.074460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.075436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.076669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.077616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:21.079598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:21.095825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1036/2072] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:21.099703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:21.123743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880d190-fd01-4960-b1cd-c3083eb27b82 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:21.141033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37ca21-65cd-4849-91b6-3c23f89300d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.141443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ca21-65cd-4849-91b6-3c23f89300d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.141722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ca21-65cd-4849-91b6-3c23f89300d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.141993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ca21-65cd-4849-91b6-3c23f89300d4 admin admin] PATH_INFO: `/v3/projects/0a83f62bbeb94357977021ad5d90c8c7/users/1ab8e8bf77ea429bbf91db7ae5be3d86/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.165834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1037/2073] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:21.177916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:21.180034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.193574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37ca21-65cd-4849-91b6-3c23f89300d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a83f62bbeb94357977021ad5d90c8c7, user_id=1ab8e8bf77ea429bbf91db7ae5be3d86, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:21.198113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37ca21-65cd-4849-91b6-3c23f89300d4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:21.245463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1037/2074] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:21 2022] PUT /identity/v3/projects/0a83f62bbeb94357977021ad5d90c8c7/users/1ab8e8bf77ea429bbf91db7ae5be3d86/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:21.255910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.256317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.257252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.298740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] MFA Rules not processed for user `1ab8e8bf77ea429bbf91db7ae5be3d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:21.300555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.300723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:21.307702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4bfd-bf69-4139-aa12-5711ee6a1d8e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:21.348875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:21.379225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.380249 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.380597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.380955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.412076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1038/2075] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:21.453409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:21.455313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.473934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:21.477092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:21.488849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1038/2076] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:21.538551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7f238-7b9f-4257-8038-60c5179c734d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:21.542277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63bcb1-b8a5-4a1b-82ae-24cec7d7136e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.542880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63bcb1-b8a5-4a1b-82ae-24cec7d7136e service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.543181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63bcb1-b8a5-4a1b-82ae-24cec7d7136e service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.543458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63bcb1-b8a5-4a1b-82ae-24cec7d7136e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.552512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63bcb1-b8a5-4a1b-82ae-24cec7d7136e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:21.554522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63bcb1-b8a5-4a1b-82ae-24cec7d7136e service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:21.564405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1039/2077] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:21.581569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:21.592456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70dfcb-237a-4278-b825-8386e274fc56 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:21.597587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.598212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.598528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.598746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] PATH_INFO: `/v3/users/1ab8e8bf77ea429bbf91db7ae5be3d86` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.599901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab8e8bf77ea429bbf91db7ae5be3d86)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:21.602322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:21.674629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab8e8bf77ea429bbf91db7ae5be3d86'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:21.689603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab8e8bf77ea429bbf91db7ae5be3d86'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:21.700704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab8e8bf77ea429bbf91db7ae5be3d86'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:21.701425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab8e8bf77ea429bbf91db7ae5be3d86'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:21.711501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1a77fd08-106f-4b59-873f-9ff8e96e1964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab8e8bf77ea429bbf91db7ae5be3d86'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:21.719922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1039/2078] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:21 2022] DELETE /identity/v3/users/1ab8e8bf77ea429bbf91db7ae5be3d86 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:21.727693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.728198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.728574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.760591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:21.762419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.778290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7c1f-1b2e-4f08-a6cf-d90b610f1d59 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.779284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7c1f-1b2e-4f08-a6cf-d90b610f1d59 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.779876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7c1f-1b2e-4f08-a6cf-d90b610f1d59 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.782498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1040/2079] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:57:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:21.791655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.791937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.792213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.836067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:21.837338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.852686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1040/2080] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:21.865549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:21.868553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.873895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:21.934196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1041/2081] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:57:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:21.935164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:21.937801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.947651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0d9c7-7923-4527-a73e-2a1fa7618915 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:21.951522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.952119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.952394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.952657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.952996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f147d19-bc70-494f-999a-cbdf0d19512f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:21.957632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.958328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.958669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.959020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] PATH_INFO: `/v3/users/25dc03c038c8440aa9a0dbbd77b4a6d1` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.960614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25dc03c038c8440aa9a0dbbd77b4a6d1)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:21.962222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:21.962559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:21.963784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:21.973435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1041/2082] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:21.974318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:21.975967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:21.989089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a11ab-0e0f-4077-a33c-3a2d9f776406 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:21.995873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:21.996592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:21.996966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:21.997381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] PATH_INFO: `/v3/projects/5a4e904bf5bb41c7b55d7d841847a881` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:21.998765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4e904bf5bb41c7b55d7d841847a881)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:22.001031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:22.014735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:22.018071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25dc03c038c8440aa9a0dbbd77b4a6d1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.036784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25dc03c038c8440aa9a0dbbd77b4a6d1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.046830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25dc03c038c8440aa9a0dbbd77b4a6d1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.047587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25dc03c038c8440aa9a0dbbd77b4a6d1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.059656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9fe757af-a535-48f3-8b6a-3416e93cf661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25dc03c038c8440aa9a0dbbd77b4a6d1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.065429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4e904bf5bb41c7b55d7d841847a881', 'request_id': 'req-468f24d3-4521-4f12-a992-ba5900648c26'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.068412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1042/2083] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:21 2022] DELETE /identity/v3/users/25dc03c038c8440aa9a0dbbd77b4a6d1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:22.070164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6044-c5da-4e03-b8b1-eb159c61b889 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.070553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6044-c5da-4e03-b8b1-eb159c61b889 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.070945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a6044-c5da-4e03-b8b1-eb159c61b889 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.078683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4e904bf5bb41c7b55d7d841847a881', 'request_id': 'req-468f24d3-4521-4f12-a992-ba5900648c26'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.087531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4e904bf5bb41c7b55d7d841847a881', 'request_id': 'req-468f24d3-4521-4f12-a992-ba5900648c26'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.088235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1043/2084] 10.222.0.42 () {54 vars in 961 bytes} [Mon Sep 19 11:57:22 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:22.093572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1205b9-db48-4ad2-ae84-f8c7d2db7c73 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.093799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1205b9-db48-4ad2-ae84-f8c7d2db7c73 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.094126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1205b9-db48-4ad2-ae84-f8c7d2db7c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.104827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] The token cache is being invalidate because project 5a4e904bf5bb41c7b55d7d841847a881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:22.105133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.106050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.108194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1042/2085] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:21 2022] DELETE /identity/v3/projects/5a4e904bf5bb41c7b55d7d841847a881 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:22.113698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:22.117962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.129534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ad1205b9-db48-4ad2-ae84-f8c7d2db7c73 None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:22.131196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ad1205b9-db48-4ad2-ae84-f8c7d2db7c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.255938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1044/2086] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Sep 19 11:57:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:22.255938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1205b9-db48-4ad2-ae84-f8c7d2db7c73 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:22.257638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f24d3-4521-4f12-a992-ba5900648c26 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:22.262344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1205b9-db48-4ad2-ae84-f8c7d2db7c73 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:22.281052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:22.281597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.281911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.282217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.286000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.315651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:22.317750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:22.330056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1045/2087] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:22.331180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:22.332725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.363641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:22.400758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:22.401903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.402182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.402459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] PATH_INFO: `/v3/users/22914401d4894691b1746dc1bbb98e28` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.403694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22914401d4894691b1746dc1bbb98e28)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:22.406101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:22.427983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aa2eb-c62c-4252-bef3-d46af8936ae0 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:22.433001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:22.433660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.433936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.434205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] PATH_INFO: `/v3/projects/fccae6b3f58d44099d536c045bb5e7d8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.435536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fccae6b3f58d44099d536c045bb5e7d8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:22.437758 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:22.459509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22914401d4894691b1746dc1bbb98e28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.462431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:22.469733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22914401d4894691b1746dc1bbb98e28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.472025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22914401d4894691b1746dc1bbb98e28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.485609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22914401d4894691b1746dc1bbb98e28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.488570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fccae6b3f58d44099d536c045bb5e7d8', 'request_id': 'req-d45220e4-5c8b-4610-9868-15299202df77'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.492784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22914401d4894691b1746dc1bbb98e28'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.497845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fccae6b3f58d44099d536c045bb5e7d8', 'request_id': 'req-d45220e4-5c8b-4610-9868-15299202df77'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.499634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1043/2088] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:22 2022] DELETE /identity/v3/users/22914401d4894691b1746dc1bbb98e28 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:22.500320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:22.501677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.508586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fccae6b3f58d44099d536c045bb5e7d8', 'request_id': 'req-d45220e4-5c8b-4610-9868-15299202df77'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.526200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] The token cache is being invalidate because project fccae6b3f58d44099d536c045bb5e7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:22.526560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.527432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d45220e4-5c8b-4610-9868-15299202df77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.533381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1046/2089] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:22 2022] DELETE /identity/v3/projects/fccae6b3f58d44099d536c045bb5e7d8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:22.535237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.535520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.535973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.583727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:22.585700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.614071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0c95-f28b-42e1-83a5-19444ed37034 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:22.620811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:22.621920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.622675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.622960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] PATH_INFO: `/v3/projects/0a83f62bbeb94357977021ad5d90c8c7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.624468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a83f62bbeb94357977021ad5d90c8c7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:22.626650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:22.709755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a83f62bbeb94357977021ad5d90c8c7', 'request_id': 'req-2343ed02-3216-4d76-a4f2-a6a7c769face'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.714702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1047/2090] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:22.716030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:22.717587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.727331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a83f62bbeb94357977021ad5d90c8c7', 'request_id': 'req-2343ed02-3216-4d76-a4f2-a6a7c769face'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.733767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a83f62bbeb94357977021ad5d90c8c7', 'request_id': 'req-2343ed02-3216-4d76-a4f2-a6a7c769face'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.750286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] The token cache is being invalidate because project 0a83f62bbeb94357977021ad5d90c8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:22.750709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.751529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2343ed02-3216-4d76-a4f2-a6a7c769face admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:22.753811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1044/2091] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:22 2022] DELETE /identity/v3/projects/0a83f62bbeb94357977021ad5d90c8c7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:22.755186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cffa4c-ca66-4b9f-99b6-df9e5905c3ce None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.755564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cffa4c-ca66-4b9f-99b6-df9e5905c3ce None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.755928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cffa4c-ca66-4b9f-99b6-df9e5905c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.780075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-46cffa4c-ca66-4b9f-99b6-df9e5905c3ce None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:22.781524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-46cffa4c-ca66-4b9f-99b6-df9e5905c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.796501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:22.802295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1626b8-36b6-4a54-8aa1-67fc28f1944b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:22.877099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:22.888619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:22.889252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.889532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.889796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.890433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1045/2092] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:22.891945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.892306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.892774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.894904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.914188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:22.915380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.923398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1046/2093] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:22.924312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:22.925701 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:22.937739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80a67-255a-4b9a-a0cb-e90c0f211e3b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:22.942311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:22.942920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:22.943193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:22.943462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] PATH_INFO: `/v3/projects/fa029e2f1f2243dfb7aebe726b365c1b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:22.945427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa029e2f1f2243dfb7aebe726b365c1b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:22.947546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:22.964776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:22.966163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:22.977590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1048/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:22.978246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:22.988278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b8b0-bff0-40e2-a3cc-26a0034a1632 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:22.999102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa029e2f1f2243dfb7aebe726b365c1b', 'request_id': 'req-2904025f-1e0a-4521-b6b6-ba23e0fa2359'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:23.007644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa029e2f1f2243dfb7aebe726b365c1b', 'request_id': 'req-2904025f-1e0a-4521-b6b6-ba23e0fa2359'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:23.015024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa029e2f1f2243dfb7aebe726b365c1b', 'request_id': 'req-2904025f-1e0a-4521-b6b6-ba23e0fa2359'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:23.029964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] The token cache is being invalidate because project fa029e2f1f2243dfb7aebe726b365c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:23.030383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:23.031065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2904025f-1e0a-4521-b6b6-ba23e0fa2359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:23.032594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1047/2095] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:22 2022] DELETE /identity/v3/projects/fa029e2f1f2243dfb7aebe726b365c1b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:23.040021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d75ac-0af3-4499-a549-6abc0ff46fae None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.040544 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d75ac-0af3-4499-a549-6abc0ff46fae None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.040824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d75ac-0af3-4499-a549-6abc0ff46fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.060916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.061628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7e1d75ac-0af3-4499-a549-6abc0ff46fae None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:23.061749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.061902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.062166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.062812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:23.062922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e1d75ac-0af3-4499-a549-6abc0ff46fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:23.063108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.064703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.074860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1048/2096] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:23.076124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.076475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.076659 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.086070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1049/2097] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:23.087050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.096928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef701-ac1a-4fed-90c7-6bd0670b1762 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.103110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1492c3c-5d9e-46cd-8ea1-6c6db26b56b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.103253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:23.103749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492c3c-5d9e-46cd-8ea1-6c6db26b56b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.103983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492c3c-5d9e-46cd-8ea1-6c6db26b56b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.104255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492c3c-5d9e-46cd-8ea1-6c6db26b56b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.104852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:23.105085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492c3c-5d9e-46cd-8ea1-6c6db26b56b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:23.105267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492c3c-5d9e-46cd-8ea1-6c6db26b56b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.106843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492c3c-5d9e-46cd-8ea1-6c6db26b56b0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.126178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1049/2098] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:23.126178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.126178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:23.130983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293ff3-f5de-427e-a73c-ef6d512c8ec5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.133687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1050/2099] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:23.135616 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf174-35fa-411f-bfb0-78a06170f52f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.136081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf174-35fa-411f-bfb0-78a06170f52f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.136348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaf174-35fa-411f-bfb0-78a06170f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.139169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.139845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.140215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.140411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.141038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.142949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.160510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6eaaf174-35fa-411f-bfb0-78a06170f52f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:23.161995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6eaaf174-35fa-411f-bfb0-78a06170f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:23.172700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1051/2100] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:23.173548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf174-35fa-411f-bfb0-78a06170f52f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.181112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1050/2101] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:23.182291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.189446 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaf174-35fa-411f-bfb0-78a06170f52f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.219543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:23.255342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3905e-ad48-4b30-b56c-b38d8b58bb32 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.257287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.257896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.258171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.258437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.259063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.260938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.261045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.261667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.261941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.262206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.262848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:23.263141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.265038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.277395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1051/2102] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:23.278342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.289507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc527cf-413c-4c0f-b99c-874e616e67c7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.294048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1052/2103] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:23.294048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.330903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:23.365054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2235b5-e367-404e-b4b8-3972feb9ca5e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.367030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.367694 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.367970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.368234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.368882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.370473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.370880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.371077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.371353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.371625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.372279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.374253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.393784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1052/2104] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:23.394585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.407351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d564-c6fa-4e52-9ae5-016bb1d5af38 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.412100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.413215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1053/2105] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:23.413670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.414247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.414393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.414714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.415811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.418155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.443092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1053/2106] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:23.443850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.454499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a48afc-bdde-42a4-b9e8-e79b08e3ceec admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.492294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86aff2-a2cc-4d5b-b82f-5efaaf88914f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.498565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.499220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.499492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.499765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.500402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.502011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.519218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1054/2107] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:23.519218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.529139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.529788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa6daf-4371-4a59-b3e8-6352b70c80c7 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.529923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.530238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.530577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.531324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.533445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.535826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.536574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.536851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.537120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.537856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.539414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.551361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1055/2108] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:23.552335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.556835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1054/2109] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:23.557736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.563172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8f3c-1d6b-4fa2-9ce8-53b57e041676 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.567513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd63fd-04c4-4d76-8d6b-8f1b6cda971e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.567849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.568438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.568734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.569246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.569868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.571598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.573268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.574297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.574580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.574850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.575497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.577106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.582576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1056/2110] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:23.583447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.593875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1055/2111] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:23.593875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.594116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837b8d3-fa55-4934-b96f-d5aa19aa0255 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.599002 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.599756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.600781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.601102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.601845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.603581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.603731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24395b79-d8ba-4e79-90e7-bae3316c4c2f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.608486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.609425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.609693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.609964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] PATH_INFO: `/v3/projects/e37d9058772e468e9d64847696bf93e7/users/819dec5d189b4df9b23e1adf323b2dce/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.614746 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1057/2112] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:23.615500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.620872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:23.626713 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c38-5e62-4a7e-9cb2-2a52ba08fe52 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.631540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37d9058772e468e9d64847696bf93e7, user_id=819dec5d189b4df9b23e1adf323b2dce, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.633415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b7af4-8ecc-47a0-80b0-7b7184538e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.634071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b7af4-8ecc-47a0-80b0-7b7184538e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.634342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b7af4-8ecc-47a0-80b0-7b7184538e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.634615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b7af4-8ecc-47a0-80b0-7b7184538e74 admin admin] PATH_INFO: `/v3/projects/969ecacecc21410fa5376c517328ebca/users/be649c1e9e994fedbe25f5a691b4b54b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.634970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.651329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1056/2113] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:23 2022] PUT /identity/v3/projects/e37d9058772e468e9d64847696bf93e7/users/819dec5d189b4df9b23e1adf323b2dce/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:23.654104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.664065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b7af4-8ecc-47a0-80b0-7b7184538e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969ecacecc21410fa5376c517328ebca, user_id=be649c1e9e994fedbe25f5a691b4b54b, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.667006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b7af4-8ecc-47a0-80b0-7b7184538e74 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.683144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1058/2114] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:23 2022] PUT /identity/v3/projects/969ecacecc21410fa5376c517328ebca/users/be649c1e9e994fedbe25f5a691b4b54b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:23.684568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64f90-6cde-4b7b-86cc-bd88778b532a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.685463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64f90-6cde-4b7b-86cc-bd88778b532a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.685877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64f90-6cde-4b7b-86cc-bd88778b532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.717009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4ff64f90-6cde-4b7b-86cc-bd88778b532a None None] MFA Rules not processed for user `819dec5d189b4df9b23e1adf323b2dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:23.718363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4ff64f90-6cde-4b7b-86cc-bd88778b532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:23.732405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:23.737633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e159-8be2-4559-b9ca-08f48b39d67e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.793034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1059/2115] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:23.796776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa892-96d4-4704-a62f-1b31a1a22813 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.796776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa892-96d4-4704-a62f-1b31a1a22813 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.796776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa892-96d4-4704-a62f-1b31a1a22813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.813255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.814122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.814516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.814863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.815588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.817284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.830419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1057/2116] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:23.830640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a36fa892-96d4-4704-a62f-1b31a1a22813 None None] MFA Rules not processed for user `be649c1e9e994fedbe25f5a691b4b54b`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:23.831492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.832191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a36fa892-96d4-4704-a62f-1b31a1a22813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:23.843781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36678-487b-4deb-88a3-9378074b78ab admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.849201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.850745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.851025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.851401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:23.851923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:23.853854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:23.888796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1058/2117] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:23.889713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.923146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1060/2118] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:23.926102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa892-96d4-4704-a62f-1b31a1a22813 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:23.944307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa892-96d4-4704-a62f-1b31a1a22813 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.980306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53e7a1-db59-41a2-8b2e-6cd9c70eb5e6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:23.985899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:23.986862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:23.986862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:23.987175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] PATH_INFO: `/v3/projects/b84471518dfb4087892baee15112ae5d/users/5931b2b5e5924d6781494c5f1b382e08/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.007196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84471518dfb4087892baee15112ae5d, user_id=5931b2b5e5924d6781494c5f1b382e08, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.010795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.011936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.019660 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f35f58-5647-40d5-b10c-6488b7cc2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.020281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f35f58-5647-40d5-b10c-6488b7cc2bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.020754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f35f58-5647-40d5-b10c-6488b7cc2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.021031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f35f58-5647-40d5-b10c-6488b7cc2bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.021911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f35f58-5647-40d5-b10c-6488b7cc2bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.024553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f35f58-5647-40d5-b10c-6488b7cc2bd0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.031928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1059/2119] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:23 2022] PUT /identity/v3/projects/b84471518dfb4087892baee15112ae5d/users/5931b2b5e5924d6781494c5f1b382e08/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:24.032875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.054083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1061/2120] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:23 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:24.055598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e73b0-c74a-4b02-aed1-3503a71ef294 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.055887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e73b0-c74a-4b02-aed1-3503a71ef294 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.056238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e73b0-c74a-4b02-aed1-3503a71ef294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.106570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2c2e73b0-c74a-4b02-aed1-3503a71ef294 None None] MFA Rules not processed for user `5931b2b5e5924d6781494c5f1b382e08`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:24.108862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2c2e73b0-c74a-4b02-aed1-3503a71ef294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.125982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5b89c-5377-406f-8d19-65c010d36b56 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.130727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.131368 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.132401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.132759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.133416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.135286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.140556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.167795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1060/2121] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:24 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:24.167795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.179646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1062/2122] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:24.181049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e73b0-c74a-4b02-aed1-3503a71ef294 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.191957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e73b0-c74a-4b02-aed1-3503a71ef294 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.232310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bc1a-b3f9-4f73-8fe0-be4a2545714b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.237540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.238082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.238352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.238618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.239261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.241482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.254813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1061/2123] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:24.254813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.254813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.258932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.259548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.259828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.260103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.260735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.262675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.284141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1063/2124] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:24 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:24.284927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.295200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b968a-f447-43b8-abbb-93084b13cf84 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.299859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.300492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.300768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.301039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] PATH_INFO: `/v3/projects/9b936946a15347eaa2b00a60a6b523f5/users/6ab5d546099b4ca9ba9d343343488cd0/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.316046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082161-9fbe-4f77-8586-30f951c1c4af admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.316528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b936946a15347eaa2b00a60a6b523f5, user_id=6ab5d546099b4ca9ba9d343343488cd0, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.319975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.320447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.321050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.321365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.321640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.332493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1064/2125] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:24 2022] PUT /identity/v3/projects/9b936946a15347eaa2b00a60a6b523f5/users/6ab5d546099b4ca9ba9d343343488cd0/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:24.333352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.378551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.383276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.385038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.395658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1062/2126] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:24.396598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.399016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706545-144e-483d-9328-4a24076449d0 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.405068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.405776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.406104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.406436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.407138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.407574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3ce5c-07fd-4798-b38a-282f27415772 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.408852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.412742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.413146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.413454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.413735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.414373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.416033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.423351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1065/2127] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:24.424153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.435321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1063/2128] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:24.435321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.438032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f94a-eb4b-4c14-be7e-9cccdb8b93ee admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.442738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.442896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095b9e-fa97-4527-b5f8-62fbdde4d488 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.443350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.443626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.444501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] PATH_INFO: `/v3/users/5931b2b5e5924d6781494c5f1b382e08` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.445731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5931b2b5e5924d6781494c5f1b382e08)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.447587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.448121 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.448747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.449031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.449336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] PATH_INFO: `/v3/projects/2ba3bc76c660446aac5c6c2d45fe344a/users/ccf6d7154bc54995b4ae94fd311250fd/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.465251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba3bc76c660446aac5c6c2d45fe344a, user_id=ccf6d7154bc54995b4ae94fd311250fd, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.468675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.483652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1064/2129] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:24 2022] PUT /identity/v3/projects/2ba3bc76c660446aac5c6c2d45fe344a/users/ccf6d7154bc54995b4ae94fd311250fd/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:24.484696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.489129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.499275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5931b2b5e5924d6781494c5f1b382e08'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:24.512710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5931b2b5e5924d6781494c5f1b382e08'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:24.520901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5931b2b5e5924d6781494c5f1b382e08'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:24.521676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5931b2b5e5924d6781494c5f1b382e08'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:24.528844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5931b2b5e5924d6781494c5f1b382e08'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:24.535216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1066/2130] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:24 2022] DELETE /identity/v3/users/5931b2b5e5924d6781494c5f1b382e08 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:24.539575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.540925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.552033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac934d-28c2-4843-8fbb-5ac5f6c16348 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.607358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65d41-f89b-4627-a63a-ae953cdd2e16 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.611986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.612310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2978ce-6f3d-49d6-b538-32ab0c12861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.612644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.612942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2978ce-6f3d-49d6-b538-32ab0c12861f admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.613281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.613384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2978ce-6f3d-49d6-b538-32ab0c12861f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.613497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2978ce-6f3d-49d6-b538-32ab0c12861f admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.613587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] PATH_INFO: `/v3/projects/9b936946a15347eaa2b00a60a6b523f5/users/6ab5d546099b4ca9ba9d343343488cd0/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.614228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2978ce-6f3d-49d6-b538-32ab0c12861f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.615782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b936946a15347eaa2b00a60a6b523f5, user_id=6ab5d546099b4ca9ba9d343343488cd0, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.616021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2978ce-6f3d-49d6-b538-32ab0c12861f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.618457 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.626134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1067/2131] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:24.627307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9e01-b10e-4d3d-8065-9f2799907ee5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.627588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9e01-b10e-4d3d-8065-9f2799907ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.627854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9e01-b10e-4d3d-8065-9f2799907ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.629887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1065/2132] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:24 2022] PUT /identity/v3/projects/9b936946a15347eaa2b00a60a6b523f5/users/6ab5d546099b4ca9ba9d343343488cd0/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:24.630667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.652487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-899f9e01-b10e-4d3d-8065-9f2799907ee5 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:24.653951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-899f9e01-b10e-4d3d-8065-9f2799907ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.699624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.707575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02590d22-b566-4633-9abf-334c48a7f919 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.713604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.714260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.714546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.714823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] PATH_INFO: `/v3/projects/2ba3bc76c660446aac5c6c2d45fe344a/users/ccf6d7154bc54995b4ae94fd311250fd/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.716723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba3bc76c660446aac5c6c2d45fe344a, user_id=ccf6d7154bc54995b4ae94fd311250fd, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.719444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.724932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1068/2133] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:24.724932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23335b9-b31e-47f5-9daa-78cbabd7560e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.724932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23335b9-b31e-47f5-9daa-78cbabd7560e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.724932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23335b9-b31e-47f5-9daa-78cbabd7560e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.734985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1066/2134] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:24 2022] PUT /identity/v3/projects/2ba3bc76c660446aac5c6c2d45fe344a/users/ccf6d7154bc54995b4ae94fd311250fd/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:24.744135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.744135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.760556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b23335b9-b31e-47f5-9daa-78cbabd7560e None None] MFA Rules not processed for user `6ab5d546099b4ca9ba9d343343488cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:24.761818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b23335b9-b31e-47f5-9daa-78cbabd7560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.781478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.797963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b261a-dab5-4732-ba93-d343d0a840bb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.801693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.802323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.802596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.802864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.832909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1069/2135] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:24.834377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.834667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.834938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.864767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] MFA Rules not processed for user `ccf6d7154bc54995b4ae94fd311250fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:24.866663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.872120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.873664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.884024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1067/2136] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:24.884824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.886161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.945054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1070/2137] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:24.957284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:24.958700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.966350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f87bb-39aa-49d3-85d1-cc3fef550c55 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.970794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c137b-a9ff-4aa9-9afb-87c38fc5e5b6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:24.971217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.972003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.972379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.972821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.974707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:24.975332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:24.975610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:24.975882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:24.977639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:24.984519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:24.985988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:24.998332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1068/2138] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:25.048414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:25.052399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.054959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.069375 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1071/2139] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:25.098967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.109813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715e198-2311-48f5-b86d-738b74eff8f6 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.114068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2e2db-ee01-4efc-bd94-b935f377c564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.114733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e2db-ee01-4efc-bd94-b935f377c564 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.115138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e2db-ee01-4efc-bd94-b935f377c564 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.116696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e2db-ee01-4efc-bd94-b935f377c564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.119289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-eda2e2db-ee01-4efc-bd94-b935f377c564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:25.223291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e2db-ee01-4efc-bd94-b935f377c564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.225875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e2db-ee01-4efc-bd94-b935f377c564 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.241748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1069/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:25.266508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.267986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:25.291747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca139bc1-1011-47a3-ba96-1913ae14e177 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.297291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.297949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.298290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.298478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] PATH_INFO: `/v3/projects/b84471518dfb4087892baee15112ae5d` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.299736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84471518dfb4087892baee15112ae5d)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.302233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.386336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84471518dfb4087892baee15112ae5d', 'request_id': 'req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:25.401401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84471518dfb4087892baee15112ae5d', 'request_id': 'req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:25.415322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84471518dfb4087892baee15112ae5d', 'request_id': 'req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:25.447771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] The token cache is being invalidate because project b84471518dfb4087892baee15112ae5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:25.447771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:25.449422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-df15da73-d8f1-45d5-ba9d-5b239ae1cdbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:25.451668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1072/2141] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:25 2022] DELETE /identity/v3/projects/b84471518dfb4087892baee15112ae5d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:25.456435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192863d-d8be-4ca7-8f35-588b8d2f527d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.456937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192863d-d8be-4ca7-8f35-588b8d2f527d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.457193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192863d-d8be-4ca7-8f35-588b8d2f527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.482817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7192863d-d8be-4ca7-8f35-588b8d2f527d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:25.484372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7192863d-d8be-4ca7-8f35-588b8d2f527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:25.515643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:25.565307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1070/2142] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:25.567296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613acd8f-a1fa-45aa-9a85-69bbcea99b3f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.567584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613acd8f-a1fa-45aa-9a85-69bbcea99b3f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.567860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613acd8f-a1fa-45aa-9a85-69bbcea99b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.592753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-613acd8f-a1fa-45aa-9a85-69bbcea99b3f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:25.593976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-613acd8f-a1fa-45aa-9a85-69bbcea99b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:25.603241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1073/2143] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:25.607345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192863d-d8be-4ca7-8f35-588b8d2f527d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.617790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192863d-d8be-4ca7-8f35-588b8d2f527d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.622280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.622865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.623139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.623405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.624044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:25.624341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.625952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.637689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1071/2144] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:25.642078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613acd8f-a1fa-45aa-9a85-69bbcea99b3f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.653895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613acd8f-a1fa-45aa-9a85-69bbcea99b3f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.659040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.659721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.660531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.660811 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.661492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.664022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.695703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1074/2145] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:25 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:25.698006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.708574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d26035-940f-42d6-8be4-c72147e56e53 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.766094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.766620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.766897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.767169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.767786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.769729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.791774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1072/2146] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:25 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:25.795949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.806817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc458-2ce7-4388-944a-f2c9b3e8c572 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.811624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.812257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.812497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.812763 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.813436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.815041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.824969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1075/2147] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:25.828885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.839487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55066-7433-4a62-b902-505706e216a8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.844050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08c0e-e5fd-43cb-a959-e3d3f0632395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.844638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08c0e-e5fd-43cb-a959-e3d3f0632395 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.844917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08c0e-e5fd-43cb-a959-e3d3f0632395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.845221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08c0e-e5fd-43cb-a959-e3d3f0632395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.845901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08c0e-e5fd-43cb-a959-e3d3f0632395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.847465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08c0e-e5fd-43cb-a959-e3d3f0632395 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.858633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1073/2148] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:25.862847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:25.872725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823baf18-780f-4583-b626-7d97faa12e31 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:25.877378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:25.878015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.878295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.878570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] PATH_INFO: `/v3/projects/1aa93dc5453c471d8f2c7cfc405cedeb/users/d500e009726c426fa292489d19612449/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.893135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa93dc5453c471d8f2c7cfc405cedeb, user_id=d500e009726c426fa292489d19612449, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:25.895801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:25.909406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1076/2149] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:25 2022] PUT /identity/v3/projects/1aa93dc5453c471d8f2c7cfc405cedeb/users/d500e009726c426fa292489d19612449/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:25.920500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:25.920790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:25.921062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:25.948855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] MFA Rules not processed for user `d500e009726c426fa292489d19612449`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:25.950078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:26.014862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1074/2150] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:26.026553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:26.028324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:26.086663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db41895-bcc0-4d55-a72c-ba7241d8a591 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:26.090522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b824c4-a0ae-479d-bdad-cb60a61b5a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:26.091121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b824c4-a0ae-479d-bdad-cb60a61b5a87 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:26.091401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b824c4-a0ae-479d-bdad-cb60a61b5a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:26.091668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b824c4-a0ae-479d-bdad-cb60a61b5a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:26.100211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b824c4-a0ae-479d-bdad-cb60a61b5a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:26.101670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b824c4-a0ae-479d-bdad-cb60a61b5a87 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:26.110917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1077/2151] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:27.880304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:27.884666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:27.917173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:27.969949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82d745-93a8-482b-b406-90fdb15118c2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:27.974901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:27.975744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:27.976160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:27.976433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] PATH_INFO: `/v3/users/be649c1e9e994fedbe25f5a691b4b54b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:27.977610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be649c1e9e994fedbe25f5a691b4b54b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:27.979500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:28.036606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be649c1e9e994fedbe25f5a691b4b54b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.045509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be649c1e9e994fedbe25f5a691b4b54b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.046221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be649c1e9e994fedbe25f5a691b4b54b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.059955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be649c1e9e994fedbe25f5a691b4b54b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.066955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be649c1e9e994fedbe25f5a691b4b54b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.074061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1075/2152] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:27 2022] DELETE /identity/v3/users/be649c1e9e994fedbe25f5a691b4b54b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:28.078469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:28.078915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:28.079032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:28.098546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:28.099760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:28.113103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:28.164911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1078/2153] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:28.175958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:28.177516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:28.243704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c16c96-632f-4328-ae78-0ccfe891c078 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:28.252756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:28.253402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:28.253936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:28.254212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:28.265064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:28.266519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:28.277292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1076/2154] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:28.561254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:28.562864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:28.578342 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c9788-ca04-42c7-84e8-9144e0f7fbf7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:28.583292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:28.584053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:28.584887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:28.585184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] PATH_INFO: `/v3/projects/969ecacecc21410fa5376c517328ebca` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:28.586372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969ecacecc21410fa5376c517328ebca)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:28.588448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:28.636750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969ecacecc21410fa5376c517328ebca', 'request_id': 'req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.644118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969ecacecc21410fa5376c517328ebca', 'request_id': 'req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.651971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969ecacecc21410fa5376c517328ebca', 'request_id': 'req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.668516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] The token cache is being invalidate because project 969ecacecc21410fa5376c517328ebca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:28.668863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.669524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.670990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1079/2155] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:28 2022] DELETE /identity/v3/projects/969ecacecc21410fa5376c517328ebca => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:28.675620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:28.685979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e8d0-3cc1-46e2-8bfa-8b0f81f2574d service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:28.732527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:28.747067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:28.747788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:28.748133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:28.748531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] PATH_INFO: `/v3/users/ccf6d7154bc54995b4ae94fd311250fd` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:28.749920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf6d7154bc54995b4ae94fd311250fd)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:28.752061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:28.800866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf6d7154bc54995b4ae94fd311250fd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.813713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf6d7154bc54995b4ae94fd311250fd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.814483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf6d7154bc54995b4ae94fd311250fd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.829895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf6d7154bc54995b4ae94fd311250fd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.838770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-9bf8bdfe-81dc-46e0-97f8-fafb5e633f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf6d7154bc54995b4ae94fd311250fd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:28.844911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1077/2156] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:28 2022] DELETE /identity/v3/users/ccf6d7154bc54995b4ae94fd311250fd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:29.186877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:29.188351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:29.205580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fa5b8-e4e3-4f7a-8a1a-e2196fd7d0a8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:29.280341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:29.280979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.281357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.281643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] PATH_INFO: `/v3/projects/2ba3bc76c660446aac5c6c2d45fe344a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.282784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba3bc76c660446aac5c6c2d45fe344a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:29.284954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:29.346692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:29.352347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba3bc76c660446aac5c6c2d45fe344a', 'request_id': 'req-e2390e1e-cd02-422e-94aa-7867f298a70b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:29.363645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba3bc76c660446aac5c6c2d45fe344a', 'request_id': 'req-e2390e1e-cd02-422e-94aa-7867f298a70b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:29.376986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba3bc76c660446aac5c6c2d45fe344a', 'request_id': 'req-e2390e1e-cd02-422e-94aa-7867f298a70b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:29.389856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] The token cache is being invalidate because project 2ba3bc76c660446aac5c6c2d45fe344a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:29.390145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:29.390806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e2390e1e-cd02-422e-94aa-7867f298a70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:29.392304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1080/2157] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:29 2022] DELETE /identity/v3/projects/2ba3bc76c660446aac5c6c2d45fe344a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:29.397852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d8aa-8369-4379-b4a8-9aa359b8f5c2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.398309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d8aa-8369-4379-b4a8-9aa359b8f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.398309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d8aa-8369-4379-b4a8-9aa359b8f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.434023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0b67d8aa-8369-4379-b4a8-9aa359b8f5c2 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:29.435438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0b67d8aa-8369-4379-b4a8-9aa359b8f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:29.519642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1078/2158] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:29.528690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a695-3edf-422f-b589-e3810ee93173 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.529044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a695-3edf-422f-b589-e3810ee93173 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.529569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6a695-3edf-422f-b589-e3810ee93173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.558845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-77e6a695-3edf-422f-b589-e3810ee93173 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:29.560324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-77e6a695-3edf-422f-b589-e3810ee93173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:29.570604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1081/2159] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:29.575385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d8aa-8369-4379-b4a8-9aa359b8f5c2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:29.585767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d8aa-8369-4379-b4a8-9aa359b8f5c2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:29.590693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:29.591297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.591577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.591846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.592580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:29.593067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:29.594735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:29.607454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1079/2160] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:29.612430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6a695-3edf-422f-b589-e3810ee93173 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:29.623011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6a695-3edf-422f-b589-e3810ee93173 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:29.628549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:29.629303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.629587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.629856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.630509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:29.633192 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:29.668911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1082/2161] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:29 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:29.673432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:29.686779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d46d6-93df-4100-a6ca-c8cd47d1399b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:29.740105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:29.755840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:29.757079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.757468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.757858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.758617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:29.760913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:29.789944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1080/2162] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:29 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:29.793852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:29.804990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04c7fb-d347-4d67-ac12-2b10fd3b88b1 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:29.810719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:29.811637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.811973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.812321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.813038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:29.814711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:29.825380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1083/2163] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:29.829505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:29.840593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745b588-58f0-4e62-aa7a-0c983a86a493 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:29.845447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3b0a-e439-40a1-aed2-08069370212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:29.846067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3b0a-e439-40a1-aed2-08069370212a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.846338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3b0a-e439-40a1-aed2-08069370212a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.846604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3b0a-e439-40a1-aed2-08069370212a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.847250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae3b0a-e439-40a1-aed2-08069370212a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:29.848944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae3b0a-e439-40a1-aed2-08069370212a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:29.861257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1081/2164] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:29.865769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:29.876726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8d889-2101-4fc2-8599-9730a24a5587 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:29.881445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:29.882190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.882512 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.882788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] PATH_INFO: `/v3/projects/5204e924dfe34b0c90174be0b36a3915/users/3d0862651425448eae3fa7027fe90b8e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.897621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5204e924dfe34b0c90174be0b36a3915, user_id=3d0862651425448eae3fa7027fe90b8e, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:29.900539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:29.915344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1084/2165] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:29 2022] PUT /identity/v3/projects/5204e924dfe34b0c90174be0b36a3915/users/3d0862651425448eae3fa7027fe90b8e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:29.925535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931aeda-9e9e-4c69-9cb5-047d1d076367 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:29.925825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931aeda-9e9e-4c69-9cb5-047d1d076367 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:29.926102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931aeda-9e9e-4c69-9cb5-047d1d076367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:29.954206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f931aeda-9e9e-4c69-9cb5-047d1d076367 None None] MFA Rules not processed for user `3d0862651425448eae3fa7027fe90b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:29.955432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f931aeda-9e9e-4c69-9cb5-047d1d076367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:30.020052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1082/2166] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:30.024646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.086931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff69e-355f-4f4e-87f4-4c8c6182160a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.091662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.092259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.092540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.092815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.093517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.095462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.123545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1085/2167] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:30 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:30.127923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931aeda-9e9e-4c69-9cb5-047d1d076367 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.139366 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931aeda-9e9e-4c69-9cb5-047d1d076367 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.200270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.200881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.201199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.201474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.202161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.204079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.228795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1083/2168] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:30 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:30.231217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.242592 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd61f-2b81-4459-8f72-65a1cfa16076 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.247334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.247940 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.248218 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.248489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.249141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.250778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.262331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1086/2169] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:30.266227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.276872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b8303-2229-494c-9939-5236d0192cb1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.281567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ce0f6-2677-4cbd-bbcb-3fc255cc6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.282165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ce0f6-2677-4cbd-bbcb-3fc255cc6f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.282443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ce0f6-2677-4cbd-bbcb-3fc255cc6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.282737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ce0f6-2677-4cbd-bbcb-3fc255cc6f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.283531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ce0f6-2677-4cbd-bbcb-3fc255cc6f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.285120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ce0f6-2677-4cbd-bbcb-3fc255cc6f82 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.296177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1084/2170] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:30.300562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.311621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055110d-42ae-47c0-9f4a-85239ad9b7a2 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.317236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.317932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.318211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.318537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] PATH_INFO: `/v3/projects/ac11167ddd2545f2bf370b78e76dff35/users/11bcf902e0e34ecc97ffda8c10e26cd3/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.341790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac11167ddd2545f2bf370b78e76dff35, user_id=11bcf902e0e34ecc97ffda8c10e26cd3, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.344406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.357564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1087/2171] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:30 2022] PUT /identity/v3/projects/ac11167ddd2545f2bf370b78e76dff35/users/11bcf902e0e34ecc97ffda8c10e26cd3/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:30.368969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f90b-d1cc-4e66-b7df-ca311f697f6a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.369283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f90b-d1cc-4e66-b7df-ca311f697f6a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.369561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7f90b-d1cc-4e66-b7df-ca311f697f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.397345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c6c7f90b-d1cc-4e66-b7df-ca311f697f6a None None] MFA Rules not processed for user `11bcf902e0e34ecc97ffda8c10e26cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:30.398542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c6c7f90b-d1cc-4e66-b7df-ca311f697f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:30.429957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:30.470370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1085/2172] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:30.477707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.498887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:30.549852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af659e-4103-4ced-a432-b822ddba1c60 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.555369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.555966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.556240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.556511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.557141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.559128 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.593206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1088/2173] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:30 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:30.596951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7f90b-d1cc-4e66-b7df-ca311f697f6a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.608992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7f90b-d1cc-4e66-b7df-ca311f697f6a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.681994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.682689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.682966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.683326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.684080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.686110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.716722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1086/2174] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:30 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:30.718881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.731369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cc0eb-a6e4-4a53-94f1-10c1faf5ae9f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.737468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.738158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.738480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.738760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.739428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.741486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.757257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1089/2175] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:30.762495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.774159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a9c0-6589-41ca-a964-df6dda39c829 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.778929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.779580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.779856 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.780125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] PATH_INFO: `/v3/projects/ac3329e364f14450b49d701cb8607fe2/users/405c08132fa04fbfae69174ffa9c0414/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.798310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3329e364f14450b49d701cb8607fe2, user_id=405c08132fa04fbfae69174ffa9c0414, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.801211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.817226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1087/2176] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:30 2022] PUT /identity/v3/projects/ac3329e364f14450b49d701cb8607fe2/users/405c08132fa04fbfae69174ffa9c0414/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:30.822048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.831867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3ad2-1ac6-49d0-9bde-6ae371408a30 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.892782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5ae8-cda5-4132-952d-09fa735eef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.893411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5ae8-cda5-4132-952d-09fa735eef7f admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.893683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5ae8-cda5-4132-952d-09fa735eef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.893950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5ae8-cda5-4132-952d-09fa735eef7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.894581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d5ae8-cda5-4132-952d-09fa735eef7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.896146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d5ae8-cda5-4132-952d-09fa735eef7f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.906231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1090/2177] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:30.910511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:30.921205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca391-56b3-4331-8bd7-fd120d7664fb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:30.926017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:30.927276 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:30.927550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:30.927815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] PATH_INFO: `/v3/projects/ac3329e364f14450b49d701cb8607fe2/users/405c08132fa04fbfae69174ffa9c0414/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:30.930864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3329e364f14450b49d701cb8607fe2, user_id=405c08132fa04fbfae69174ffa9c0414, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:30.933572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:30.944371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1088/2178] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:30 2022] PUT /identity/v3/projects/ac3329e364f14450b49d701cb8607fe2/users/405c08132fa04fbfae69174ffa9c0414/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:31.014285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:31.014571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:31.014829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:31.043217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] MFA Rules not processed for user `405c08132fa04fbfae69174ffa9c0414`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:31.044227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:31.117081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1091/2179] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:31.129077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:31.130906 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:31.195910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5d617-7721-4ca5-9b10-a3a67237214d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:31.199617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8024c20-a59b-48c9-9825-5a3fcabbfb2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:31.200219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8024c20-a59b-48c9-9825-5a3fcabbfb2c service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:31.200498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8024c20-a59b-48c9-9825-5a3fcabbfb2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:31.200761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8024c20-a59b-48c9-9825-5a3fcabbfb2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:31.238948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:31.264831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8024c20-a59b-48c9-9825-5a3fcabbfb2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:31.266430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8024c20-a59b-48c9-9825-5a3fcabbfb2c service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:31.276054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1089/2180] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:31.754148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:31.755583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:31.770302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:31.823606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e7cd-d236-4e2e-b4e4-cb273a0d7999 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:31.828782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:31.829750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:31.830093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:31.830283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] PATH_INFO: `/v3/users/d500e009726c426fa292489d19612449` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:31.831407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d500e009726c426fa292489d19612449)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:31.833360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:31.881784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd500e009726c426fa292489d19612449'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:31.894251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd500e009726c426fa292489d19612449'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:31.903591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd500e009726c426fa292489d19612449'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:31.904716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd500e009726c426fa292489d19612449'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:31.913356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd500e009726c426fa292489d19612449'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:31.920233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1092/2181] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:31 2022] DELETE /identity/v3/users/d500e009726c426fa292489d19612449 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:31.924541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:31.924990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:31.925117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:31.945040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:31.946305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.012355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1090/2182] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:32.023142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.024693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.091312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da31c1-9220-4fde-abb6-051bd1fe2e4a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.095001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.095603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.095875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.096142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.106334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:32.107877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:32.119289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1093/2183] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:32.397949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.399483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.429129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b864-2d3c-4c4e-bc71-835d37f9cdad None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.431367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.432008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.432284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.432556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] PATH_INFO: `/v3/projects/1aa93dc5453c471d8f2c7cfc405cedeb` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.433861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa93dc5453c471d8f2c7cfc405cedeb)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:32.435794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:32.449704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.451212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.466168 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c377f0-46c6-46cc-98c9-1691ae48d7cb service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.472383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.473201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.473551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.473889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] PATH_INFO: `/v3/users/819dec5d189b4df9b23e1adf323b2dce` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.475156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=819dec5d189b4df9b23e1adf323b2dce)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:32.477071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:32.489872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa93dc5453c471d8f2c7cfc405cedeb', 'request_id': 'req-e0905051-4773-444d-9259-9c38e6d480ab'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.498907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa93dc5453c471d8f2c7cfc405cedeb', 'request_id': 'req-e0905051-4773-444d-9259-9c38e6d480ab'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.507201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa93dc5453c471d8f2c7cfc405cedeb', 'request_id': 'req-e0905051-4773-444d-9259-9c38e6d480ab'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.517942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:32.520476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] The token cache is being invalidate because project 1aa93dc5453c471d8f2c7cfc405cedeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:32.520766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.521704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e0905051-4773-444d-9259-9c38e6d480ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.523325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1091/2184] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:32 2022] DELETE /identity/v3/projects/1aa93dc5453c471d8f2c7cfc405cedeb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:32.528444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75b83-b9ad-4c73-9cc6-5b898a1efff5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.528668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75b83-b9ad-4c73-9cc6-5b898a1efff5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.529273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75b83-b9ad-4c73-9cc6-5b898a1efff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.535578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819dec5d189b4df9b23e1adf323b2dce'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.549061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f0d75b83-b9ad-4c73-9cc6-5b898a1efff5 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:32.549976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819dec5d189b4df9b23e1adf323b2dce'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.550295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f0d75b83-b9ad-4c73-9cc6-5b898a1efff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.559678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819dec5d189b4df9b23e1adf323b2dce'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.560745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819dec5d189b4df9b23e1adf323b2dce'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.572231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b90b902d-1ae6-4f34-b9b8-1bac6dd31f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819dec5d189b4df9b23e1adf323b2dce'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:32.578781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1094/2185] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:32 2022] DELETE /identity/v3/users/819dec5d189b4df9b23e1adf323b2dce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:32.583389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.583389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.583641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.603687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:32.604949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.614026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:32.628337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1092/2186] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:32.637344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ac6c-47fe-4093-a1f6-829b9af2ed64 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.637848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ac6c-47fe-4093-a1f6-829b9af2ed64 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.638260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921ac6c-47fe-4093-a1f6-829b9af2ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.675514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5921ac6c-47fe-4093-a1f6-829b9af2ed64 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:32.676733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5921ac6c-47fe-4093-a1f6-829b9af2ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.706247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1095/2187] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:32.718280 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.720058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.782784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1093/2188] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:32.790311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921ac6c-47fe-4093-a1f6-829b9af2ed64 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.800356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921ac6c-47fe-4093-a1f6-829b9af2ed64 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.804007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb7fd0-ae44-4f37-986d-be311531e27c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.806638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.807367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.807715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.807828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.808309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.808480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.808593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.808836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.809670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:32.810106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:32.811893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:32.821447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:32.822874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:32.825849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1094/2189] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:32.830597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.836049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1096/2190] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:32.846909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc744-9bee-441c-ba01-3fdbb9166485 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.853254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.853465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.854091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.854340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.854608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.854974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:32.855232 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:32.857114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:32.890032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1095/2191] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:32 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:32.894850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:32.934161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3133e88-b207-4ff2-aaf2-a61d244cc1c7 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.939036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:32.969199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c5f58-66e5-4655-8c76-64142364c214 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:32.978015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.978623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.978897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.979164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:32.979792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:32.981902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:32.998036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:32.998815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:32.999093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:32.999563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.005781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1096/2192] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:32 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:33.007414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.010404 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.021422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a5280-7407-4a90-85f0-22990cf9eff2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.027510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.028009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.028284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.028554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.029233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.031096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.046001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1097/2193] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:33.047033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.058846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9de45-508e-49fc-b60d-7f48b95074f4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.063604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.064202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.064479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.064757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.065430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.067171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.076352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.078027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.078961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1098/2194] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:33.082644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.090046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1097/2195] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:33.095205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68c2f-e506-4cca-a4ac-fc248811a21e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.100554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab86b-6fe8-4cb1-83d7-d0f6ea4d2397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.100994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab86b-6fe8-4cb1-83d7-d0f6ea4d2397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.101311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab86b-6fe8-4cb1-83d7-d0f6ea4d2397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.101584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab86b-6fe8-4cb1-83d7-d0f6ea4d2397 admin admin] PATH_INFO: `/v3/projects/ea70a98f26ca4ca5ac1ef745a102c7a5/users/fd27f1af38a64389a0042eaedee6657f/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.119171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab86b-6fe8-4cb1-83d7-d0f6ea4d2397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea70a98f26ca4ca5ac1ef745a102c7a5, user_id=fd27f1af38a64389a0042eaedee6657f, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.122100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab86b-6fe8-4cb1-83d7-d0f6ea4d2397 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.153058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1099/2196] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:33 2022] PUT /identity/v3/projects/ea70a98f26ca4ca5ac1ef745a102c7a5/users/fd27f1af38a64389a0042eaedee6657f/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:33.154738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.156824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.158599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe60a2-6b73-439d-8c08-7b71eee35529 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.161709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe60a2-6b73-439d-8c08-7b71eee35529 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.161998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe60a2-6b73-439d-8c08-7b71eee35529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.179261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ff9c-73fd-4cab-9dbb-8d0d87f42ef7 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.204581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:33.218109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9cfe60a2-6b73-439d-8c08-7b71eee35529 None None] MFA Rules not processed for user `fd27f1af38a64389a0042eaedee6657f`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:33.219597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9cfe60a2-6b73-439d-8c08-7b71eee35529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.273614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.274267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.274543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.274812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] PATH_INFO: `/v3/projects/e37d9058772e468e9d64847696bf93e7` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.276411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37d9058772e468e9d64847696bf93e7)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.279208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.315445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1100/2197] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:33.354025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37d9058772e468e9d64847696bf93e7', 'request_id': 'req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.363227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37d9058772e468e9d64847696bf93e7', 'request_id': 'req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.369685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:33.371195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37d9058772e468e9d64847696bf93e7', 'request_id': 'req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.386913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] The token cache is being invalidate because project e37d9058772e468e9d64847696bf93e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:33.387293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.387979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.389681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1098/2198] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:33 2022] DELETE /identity/v3/projects/e37d9058772e468e9d64847696bf93e7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:33.393875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe60a2-6b73-439d-8c08-7b71eee35529 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.408807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe60a2-6b73-439d-8c08-7b71eee35529 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.449075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.450831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.502671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.503410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.503759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.504135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] PATH_INFO: `/v3/users/6ab5d546099b4ca9ba9d343343488cd0` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.505401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab5d546099b4ca9ba9d343343488cd0)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.507471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.531907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c5b1-3119-42d5-ad1f-0d0e5faa2320 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.536673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269146-6504-47bd-a01f-677227ad1d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.538158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269146-6504-47bd-a01f-677227ad1d33 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.538708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269146-6504-47bd-a01f-677227ad1d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.539360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269146-6504-47bd-a01f-677227ad1d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.541840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-30269146-6504-47bd-a01f-677227ad1d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.571180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab5d546099b4ca9ba9d343343488cd0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.580804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab5d546099b4ca9ba9d343343488cd0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.581850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab5d546099b4ca9ba9d343343488cd0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.597213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab5d546099b4ca9ba9d343343488cd0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.606487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab5d546099b4ca9ba9d343343488cd0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.613178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1101/2199] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:33 2022] DELETE /identity/v3/users/6ab5d546099b4ca9ba9d343343488cd0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:33.633560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30269146-6504-47bd-a01f-677227ad1d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.635195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30269146-6504-47bd-a01f-677227ad1d33 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.654839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1099/2200] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:33.674704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.677193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.719946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:33.808860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562196c8-1427-46fb-a448-09f652cfbea2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:33.815336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:33.816284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.816740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.817246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] PATH_INFO: `/v3/users/fd27f1af38a64389a0042eaedee6657f` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.819659 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd27f1af38a64389a0042eaedee6657f)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:33.823778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:33.889724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd27f1af38a64389a0042eaedee6657f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.899471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd27f1af38a64389a0042eaedee6657f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.900423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd27f1af38a64389a0042eaedee6657f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.915087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd27f1af38a64389a0042eaedee6657f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.923696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd27f1af38a64389a0042eaedee6657f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:33.930986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1102/2201] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:33 2022] DELETE /identity/v3/users/fd27f1af38a64389a0042eaedee6657f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:33.937657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:33.938226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:33.938226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:33.957311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:33.959018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:33.970972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:33.972287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.044162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ff0e0-21b8-407a-a4c3-16c44e2c3d5f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.048909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.049588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.049877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.050197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.052107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.058655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1100/2202] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:34.062037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.064867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.078971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520c65-9941-44c0-90ca-3b42c00b379b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.083887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.085216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.085662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.085959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] PATH_INFO: `/v3/projects/9b936946a15347eaa2b00a60a6b523f5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.087095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b936946a15347eaa2b00a60a6b523f5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.089022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.108500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:34.127405 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.129005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.132671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:34.139133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1103/2203] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:34.139942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.140443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b936946a15347eaa2b00a60a6b523f5', 'request_id': 'req-8d0400e1-2323-43bc-80a2-e8c5ce417a51'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.141249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.150687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b936946a15347eaa2b00a60a6b523f5', 'request_id': 'req-8d0400e1-2323-43bc-80a2-e8c5ce417a51'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.158442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b936946a15347eaa2b00a60a6b523f5', 'request_id': 'req-8d0400e1-2323-43bc-80a2-e8c5ce417a51'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.170572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] The token cache is being invalidate because project 9b936946a15347eaa2b00a60a6b523f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:34.170863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.171554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8d0400e1-2323-43bc-80a2-e8c5ce417a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.173057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1101/2204] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:34 2022] DELETE /identity/v3/projects/9b936946a15347eaa2b00a60a6b523f5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:34.178633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed948c4-f300-48e8-8090-b16c6d1abb05 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.178911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed948c4-f300-48e8-8090-b16c6d1abb05 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.179214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed948c4-f300-48e8-8090-b16c6d1abb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.204701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0ed948c4-f300-48e8-8090-b16c6d1abb05 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:34.206003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0ed948c4-f300-48e8-8090-b16c6d1abb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.213567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f922cc-8717-4c35-99de-ae8e1a6178fa service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.274028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.274686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.274965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.275244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.277453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.284819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1102/2205] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:34.293493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.293680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b528c4-e76b-4502-a666-dbc1a4048d7c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.293909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b528c4-e76b-4502-a666-dbc1a4048d7c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.294237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b528c4-e76b-4502-a666-dbc1a4048d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.294961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.305522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1104/2206] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:34.314532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-22b528c4-e76b-4502-a666-dbc1a4048d7c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:34.315844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-22b528c4-e76b-4502-a666-dbc1a4048d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.324467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1103/2207] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:34.328876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.339330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6b137-7853-4d6d-b0c6-dc6115b4e6e6 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.344861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.345578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.345935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.346201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.346905 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:34.347207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.348832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.362158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1105/2208] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:34.367492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b528c4-e76b-4502-a666-dbc1a4048d7c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.377430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b528c4-e76b-4502-a666-dbc1a4048d7c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.382301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.382897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.383177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.383449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.384088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.386114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.425563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1104/2209] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:34 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:34.426728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.438268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181da66-1d72-4aaa-aab6-8f479552e97b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.507972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.508612 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.508883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.509172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.509893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.511784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.534384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1106/2210] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:34 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:34.539667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.550478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260d0d9-5ca7-477d-b9cd-e462d2e70c89 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.556631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.557321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.557604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.557888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.558558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.560143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.570836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1105/2211] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:34.574925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.586553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa60b23-bee7-4fd1-b83d-6ea3f3e999f5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.591558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.592250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.592681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.592957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.593645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.593988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.595247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.595702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.610027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab93e7-64b4-4d61-8cee-3ea0fa764f0c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.612964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1107/2212] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:34.615259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.615990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.616340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.616621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] PATH_INFO: `/v3/projects/ea70a98f26ca4ca5ac1ef745a102c7a5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.617436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.617829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea70a98f26ca4ca5ac1ef745a102c7a5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.619755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.628275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e639f24-cb54-489f-9a7e-23b2380678f1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.633643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c29e96-123c-4cd1-9119-f2308373cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.634438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c29e96-123c-4cd1-9119-f2308373cce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.634586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c29e96-123c-4cd1-9119-f2308373cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.634845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c29e96-123c-4cd1-9119-f2308373cce9 admin admin] PATH_INFO: `/v3/projects/3008ea76eed4445b81e3896d8da12c3d/users/5489a7c44a9c4b5cbd6ee26f78d664a8/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.643231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:34.655134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c29e96-123c-4cd1-9119-f2308373cce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3008ea76eed4445b81e3896d8da12c3d, user_id=5489a7c44a9c4b5cbd6ee26f78d664a8, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.660062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c29e96-123c-4cd1-9119-f2308373cce9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.675191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1108/2213] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:34 2022] PUT /identity/v3/projects/3008ea76eed4445b81e3896d8da12c3d/users/5489a7c44a9c4b5cbd6ee26f78d664a8/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:34.678428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea70a98f26ca4ca5ac1ef745a102c7a5', 'request_id': 'req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.686036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaffe7-4e2c-4e2e-8dbe-ac54862515eb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.686452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea70a98f26ca4ca5ac1ef745a102c7a5', 'request_id': 'req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.686613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaffe7-4e2c-4e2e-8dbe-ac54862515eb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.686996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaffe7-4e2c-4e2e-8dbe-ac54862515eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.692653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea70a98f26ca4ca5ac1ef745a102c7a5', 'request_id': 'req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.704605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] The token cache is being invalidate because project ea70a98f26ca4ca5ac1ef745a102c7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:34.704887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.705558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:34.707039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1106/2214] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:34 2022] DELETE /identity/v3/projects/ea70a98f26ca4ca5ac1ef745a102c7a5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:34.716615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9acaffe7-4e2c-4e2e-8dbe-ac54862515eb None None] MFA Rules not processed for user `5489a7c44a9c4b5cbd6ee26f78d664a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:34.717908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9acaffe7-4e2c-4e2e-8dbe-ac54862515eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.798089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1109/2215] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:34.802461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.803967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:34.821949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:34.884752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0792bb6-fad8-4c3b-9758-6f6730ac8ec8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:34.950386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:34.950945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:34.951347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:34.951627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:34.952264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:34.954207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:34.982156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1107/2216] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:34 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:34.986766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaffe7-4e2c-4e2e-8dbe-ac54862515eb None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:34.998376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaffe7-4e2c-4e2e-8dbe-ac54862515eb None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:35.071609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:35.072310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.072506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.072770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.073423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:35.075327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:35.102602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1110/2217] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:34 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:35.103971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:35.115142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6911e-f6d0-40fc-9a8e-f1a860c1d14c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:35.120831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:35.121463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.121738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.122430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.123008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:35.124627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:35.136174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1108/2218] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:35.140794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:35.150925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60471809-d010-4604-b2f6-03fe1e2d53d6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:35.155629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:35.156387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.156736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.157563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] PATH_INFO: `/v3/projects/14000571c4744915996b4703716b2919/users/0b8836c3604147a9bb01342b4f03c82c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.175498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14000571c4744915996b4703716b2919, user_id=0b8836c3604147a9bb01342b4f03c82c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:35.178483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:35.192214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1111/2219] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:35 2022] PUT /identity/v3/projects/14000571c4744915996b4703716b2919/users/0b8836c3604147a9bb01342b4f03c82c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:35.197252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:35.207464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964a0e-47db-45b1-a6a9-11bd33485baf admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:35.272754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f6a62-5347-41cf-b45e-f87912bab493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:35.273575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6a62-5347-41cf-b45e-f87912bab493 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.273856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6a62-5347-41cf-b45e-f87912bab493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.274174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6a62-5347-41cf-b45e-f87912bab493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.274835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f6a62-5347-41cf-b45e-f87912bab493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:35.276481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f6a62-5347-41cf-b45e-f87912bab493 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:35.287685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1109/2220] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:35.292059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:35.315959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020cd6b-4aaf-49ec-b3fc-675955916bf9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:35.322520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:35.323195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.323476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.323748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] PATH_INFO: `/v3/projects/14000571c4744915996b4703716b2919/users/0b8836c3604147a9bb01342b4f03c82c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.325898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14000571c4744915996b4703716b2919, user_id=0b8836c3604147a9bb01342b4f03c82c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:35.328997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:35.342708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1112/2221] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:35 2022] PUT /identity/v3/projects/14000571c4744915996b4703716b2919/users/0b8836c3604147a9bb01342b4f03c82c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:35.354936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.355177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.355424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.388800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] MFA Rules not processed for user `0b8836c3604147a9bb01342b4f03c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:35.390077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:35.412229 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:35.495966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1110/2222] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:35.508433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:35.510597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:35.551389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:35.592277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e316ee0-af88-48f6-a66a-916a0d3db7e1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:35.598084 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:35.598706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.598983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.599373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.610461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:35.612069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:35.627696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1113/2223] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:35.682222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:35.683601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:35.696162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465b9d-69da-4f4c-b2e3-2afedb995c81 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:35.699781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6755847-9d23-4688-b911-24f6d9b9e6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:35.700376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6755847-9d23-4688-b911-24f6d9b9e6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:35.700654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6755847-9d23-4688-b911-24f6d9b9e6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:35.700927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6755847-9d23-4688-b911-24f6d9b9e6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:35.759710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6755847-9d23-4688-b911-24f6d9b9e6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:35.761189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6755847-9d23-4688-b911-24f6d9b9e6d9 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:35.769962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1111/2224] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:38.103198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:38.104626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:38.168565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6da32-2ce5-4d92-8440-7310936a4283 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:38.173027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:38.173666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.173945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.174217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] PATH_INFO: `/v3/users/3d0862651425448eae3fa7027fe90b8e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.175330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0862651425448eae3fa7027fe90b8e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:38.177259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:38.223306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0862651425448eae3fa7027fe90b8e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.230672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0862651425448eae3fa7027fe90b8e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.231287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0862651425448eae3fa7027fe90b8e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.243585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0862651425448eae3fa7027fe90b8e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.250287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0862651425448eae3fa7027fe90b8e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.256523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1114/2225] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:38 2022] DELETE /identity/v3/users/3d0862651425448eae3fa7027fe90b8e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:38.261032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.261518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.261633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.280751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:38.281981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:38.340575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1112/2226] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:38.351161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:38.352543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:38.409513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e6b1b-f596-416e-b581-f5579c4e9f50 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:38.413261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:38.413854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.414141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.414413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.422734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:38.427345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:38.430499 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:38.440345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1115/2227] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:38.732862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:38.736059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:38.751143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d96a-fd2c-4d1a-b136-c8ac12dfe899 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:38.758099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:38.759020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.759360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.759692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] PATH_INFO: `/v3/projects/5204e924dfe34b0c90174be0b36a3915` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.760907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5204e924dfe34b0c90174be0b36a3915)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:38.762974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:38.820531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5204e924dfe34b0c90174be0b36a3915', 'request_id': 'req-a8748de5-b298-442c-b5da-c3cd2ce2980a'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.823445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:38.830698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5204e924dfe34b0c90174be0b36a3915', 'request_id': 'req-a8748de5-b298-442c-b5da-c3cd2ce2980a'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.840919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5204e924dfe34b0c90174be0b36a3915', 'request_id': 'req-a8748de5-b298-442c-b5da-c3cd2ce2980a'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.856255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] The token cache is being invalidate because project 5204e924dfe34b0c90174be0b36a3915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:38.856629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.857384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:38.859608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1113/2228] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:38 2022] DELETE /identity/v3/projects/5204e924dfe34b0c90174be0b36a3915 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:38.863605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:38.877965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688c97-a0a5-4926-b690-5d60d6fd5b88 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:38.964825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:38.965568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:38.965899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:38.966179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] PATH_INFO: `/v3/users/11bcf902e0e34ecc97ffda8c10e26cd3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:38.967598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bcf902e0e34ecc97ffda8c10e26cd3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:38.970711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.071531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bcf902e0e34ecc97ffda8c10e26cd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.082355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bcf902e0e34ecc97ffda8c10e26cd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.083205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bcf902e0e34ecc97ffda8c10e26cd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.099714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bcf902e0e34ecc97ffda8c10e26cd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.108462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bcf902e0e34ecc97ffda8c10e26cd3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.116361 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1116/2229] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:38 2022] DELETE /identity/v3/users/11bcf902e0e34ecc97ffda8c10e26cd3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:39.247802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.249691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:39.263122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748de5-b298-442c-b5da-c3cd2ce2980a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.331246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.331873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.332151 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.332418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] PATH_INFO: `/v3/users/5489a7c44a9c4b5cbd6ee26f78d664a8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.333574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5489a7c44a9c4b5cbd6ee26f78d664a8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.336026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.385498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5489a7c44a9c4b5cbd6ee26f78d664a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.400025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5489a7c44a9c4b5cbd6ee26f78d664a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.405461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.407074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:39.409245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5489a7c44a9c4b5cbd6ee26f78d664a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.409874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5489a7c44a9c4b5cbd6ee26f78d664a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.423764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ed1ea25f-e1dd-4827-8ccb-56b9bb0bc3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5489a7c44a9c4b5cbd6ee26f78d664a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.430283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1114/2230] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:39 2022] DELETE /identity/v3/users/5489a7c44a9c4b5cbd6ee26f78d664a8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:39.435039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.435340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.435540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.440251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445726b-ab21-4073-b5ba-d0a651dcf5a7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.455696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:39.456949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:39.499009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.499643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.499927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.500227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] PATH_INFO: `/v3/projects/ac11167ddd2545f2bf370b78e76dff35` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.501373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac11167ddd2545f2bf370b78e76dff35)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.503283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.512935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.520284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:39.525307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1115/2231] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:39.534469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.536210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:39.555164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac11167ddd2545f2bf370b78e76dff35', 'request_id': 'req-65d119f1-8577-4775-886b-00f78e7fee90'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.563867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac11167ddd2545f2bf370b78e76dff35', 'request_id': 'req-65d119f1-8577-4775-886b-00f78e7fee90'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.572779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac11167ddd2545f2bf370b78e76dff35', 'request_id': 'req-65d119f1-8577-4775-886b-00f78e7fee90'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.584824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] The token cache is being invalidate because project ac11167ddd2545f2bf370b78e76dff35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:39.585188 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.585815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.587339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1117/2232] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:39 2022] DELETE /identity/v3/projects/ac11167ddd2545f2bf370b78e76dff35 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:39.591103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:39.592441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:39.596993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c0ee7-00e7-46ee-884d-6e6e25d930df None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.647413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.647934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.648208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.648474 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.653966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:39.658728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d119f1-8577-4775-886b-00f78e7fee90 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:39.665845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:39.666484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:39.666760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:39.667032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] PATH_INFO: `/v3/users/405c08132fa04fbfae69174ffa9c0414` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:39.667955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.668294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405c08132fa04fbfae69174ffa9c0414)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:39.669414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.670283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:39.679651 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1116/2233] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:39.723877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405c08132fa04fbfae69174ffa9c0414'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.732152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405c08132fa04fbfae69174ffa9c0414'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.732819 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405c08132fa04fbfae69174ffa9c0414'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.746493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405c08132fa04fbfae69174ffa9c0414'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.755005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405c08132fa04fbfae69174ffa9c0414'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:39.761840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1118/2234] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:39 2022] DELETE /identity/v3/users/405c08132fa04fbfae69174ffa9c0414 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:40.031225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.033037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:40.046852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c154-ec11-426c-8084-40a5eef05d00 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.130100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.132926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:40.150040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.150874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.151492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.151492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] PATH_INFO: `/v3/projects/3008ea76eed4445b81e3896d8da12c3d` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.152725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3008ea76eed4445b81e3896d8da12c3d)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.154824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.190447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:40.210996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3008ea76eed4445b81e3896d8da12c3d', 'request_id': 'req-4c6fb8e5-c63b-456c-984e-537e14b10851'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.221086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3008ea76eed4445b81e3896d8da12c3d', 'request_id': 'req-4c6fb8e5-c63b-456c-984e-537e14b10851'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.225579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:40.230461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3008ea76eed4445b81e3896d8da12c3d', 'request_id': 'req-4c6fb8e5-c63b-456c-984e-537e14b10851'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.251596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] The token cache is being invalidate because project 3008ea76eed4445b81e3896d8da12c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:40.251596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.252427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.253075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688287c7-1d52-4a0a-963c-eaf4fedc0e34 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.254772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1117/2235] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:40 2022] DELETE /identity/v3/projects/3008ea76eed4445b81e3896d8da12c3d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:40.259977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.261407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:40.334848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.335491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.335772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.336045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] PATH_INFO: `/v3/projects/ac3329e364f14450b49d701cb8607fe2` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.337227 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3329e364f14450b49d701cb8607fe2)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.339133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.342362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb8e5-c63b-456c-984e-537e14b10851 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.347894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.348609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.349139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.349429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] PATH_INFO: `/v3/users/0b8836c3604147a9bb01342b4f03c82c` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.351870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8836c3604147a9bb01342b4f03c82c)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.354283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.395450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3329e364f14450b49d701cb8607fe2', 'request_id': 'req-11e08720-8504-403b-95f7-29c5146ac041'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.404548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3329e364f14450b49d701cb8607fe2', 'request_id': 'req-11e08720-8504-403b-95f7-29c5146ac041'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.411391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3329e364f14450b49d701cb8607fe2', 'request_id': 'req-11e08720-8504-403b-95f7-29c5146ac041'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.411782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8836c3604147a9bb01342b4f03c82c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.427566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8836c3604147a9bb01342b4f03c82c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.430834 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] The token cache is being invalidate because project ac3329e364f14450b49d701cb8607fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:40.431257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.433129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-11e08720-8504-403b-95f7-29c5146ac041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.435083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1119/2236] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:40 2022] DELETE /identity/v3/projects/ac3329e364f14450b49d701cb8607fe2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:40.439829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8836c3604147a9bb01342b4f03c82c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.440039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642ec56-f0dd-4600-ae62-f0a884327add None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.440306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642ec56-f0dd-4600-ae62-f0a884327add None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.440428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8836c3604147a9bb01342b4f03c82c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.440611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642ec56-f0dd-4600-ae62-f0a884327add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.450006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-37eb5251-b0e3-4b1a-a8ea-71d3f3b9d6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8836c3604147a9bb01342b4f03c82c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.456368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1118/2237] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:40 2022] DELETE /identity/v3/users/0b8836c3604147a9bb01342b4f03c82c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:40.463258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d642ec56-f0dd-4600-ae62-f0a884327add None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:40.464606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d642ec56-f0dd-4600-ae62-f0a884327add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:40.531196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:40.550720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9f217-b55e-454c-b6db-22cdb725e940 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.551029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9f217-b55e-454c-b6db-22cdb725e940 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.551387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9f217-b55e-454c-b6db-22cdb725e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.555071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1120/2238] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:40.577514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-eee9f217-b55e-454c-b6db-22cdb725e940 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:40.579163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-eee9f217-b55e-454c-b6db-22cdb725e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:40.607291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1119/2239] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:40.610381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642ec56-f0dd-4600-ae62-f0a884327add None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.620888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642ec56-f0dd-4600-ae62-f0a884327add None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.625939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.626581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.626864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.627136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.627789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:40.628096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.629759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.642592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1121/2240] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:40.647889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9f217-b55e-454c-b6db-22cdb725e940 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.659492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9f217-b55e-454c-b6db-22cdb725e940 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.666005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.666700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.667453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.667453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.668039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.670247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.703848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1120/2241] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:40 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:40.707816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.719952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989202a-eae8-433d-863a-b7cdfd0e2388 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.794104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.794726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.795013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.795281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.795943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.797918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.816494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.819501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:40.827392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1122/2242] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:40 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:40.831487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.852596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c82507-531e-4967-882e-2db15dddd35c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.855982 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e73c-e1a2-497e-8bd2-cb2de69e8d24 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.858345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.858908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.859189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.859749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] PATH_INFO: `/v3/projects/14000571c4744915996b4703716b2919` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.860877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14000571c4744915996b4703716b2919)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.861946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.862520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.862819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.862921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.863094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.863740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.865897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.877196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1123/2243] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:40.881310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.891196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43b5bd-123b-484b-b832-ff1b6c799ce5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.898610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.899205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.899483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.899758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.900402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:40.900980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:40.902130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:40.914203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1124/2244] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:40.916971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14000571c4744915996b4703716b2919', 'request_id': 'req-c1b52001-9f93-4100-b8a1-dc09611b29f5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.918277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:40.924629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14000571c4744915996b4703716b2919', 'request_id': 'req-c1b52001-9f93-4100-b8a1-dc09611b29f5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.929898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f362df-24da-41d1-93f1-357c320c1ed9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:40.931257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14000571c4744915996b4703716b2919', 'request_id': 'req-c1b52001-9f93-4100-b8a1-dc09611b29f5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.943115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] The token cache is being invalidate because project 14000571c4744915996b4703716b2919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:40.943997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.945026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c1b52001-9f93-4100-b8a1-dc09611b29f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:40.946559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1121/2245] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:40 2022] DELETE /identity/v3/projects/14000571c4744915996b4703716b2919 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:40.951159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0a23-e3cf-4c55-832d-c3635fc1f681 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.951437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0a23-e3cf-4c55-832d-c3635fc1f681 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.951708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0a23-e3cf-4c55-832d-c3635fc1f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:40.972207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f08b0a23-e3cf-4c55-832d-c3635fc1f681 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:40.973457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f08b0a23-e3cf-4c55-832d-c3635fc1f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:40.997635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43cafd-3a4f-43c4-92e5-92064153b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:40.998649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43cafd-3a4f-43c4-92e5-92064153b516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:40.999052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43cafd-3a4f-43c4-92e5-92064153b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:40.999332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43cafd-3a4f-43c4-92e5-92064153b516 admin admin] PATH_INFO: `/v3/projects/817d2b8950be4c9981b7db569fc7f04e/users/50eea739d1064348a2adcd4c5ba0b180/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.014913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43cafd-3a4f-43c4-92e5-92064153b516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817d2b8950be4c9981b7db569fc7f04e, user_id=50eea739d1064348a2adcd4c5ba0b180, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.017630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43cafd-3a4f-43c4-92e5-92064153b516 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.030326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1125/2246] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:40 2022] PUT /identity/v3/projects/817d2b8950be4c9981b7db569fc7f04e/users/50eea739d1064348a2adcd4c5ba0b180/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:41.035382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98b36-4d2f-42c4-9b61-888f2a1c5c3a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.035669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98b36-4d2f-42c4-9b61-888f2a1c5c3a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.035935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98b36-4d2f-42c4-9b61-888f2a1c5c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.038348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1122/2247] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:41.045697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.045976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.046278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.063110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c6d98b36-4d2f-42c4-9b61-888f2a1c5c3a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:41.063989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c6d98b36-4d2f-42c4-9b61-888f2a1c5c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:41.067647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:41.068995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:41.098597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:41.131127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1126/2248] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:41.135733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1123/2249] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:41.139930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d98b36-4d2f-42c4-9b61-888f2a1c5c3a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.140468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.141899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:41.152174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d98b36-4d2f-42c4-9b61-888f2a1c5c3a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.157758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.158746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.158746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.159123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.160219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:41.160530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.163649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.181271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1127/2250] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:57:41.182950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.195081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0b0a-1c30-4dc4-a512-21ae24c0a4f7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.199696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.200521 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.200801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.201069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.201736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.203627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.205381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc342e7-a8eb-4127-aa56-1b6eaae3d24c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.209304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.209926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.210196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.210464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.220126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.221745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.232699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1124/2251] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:41.239546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1128/2252] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:41.242327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.249744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:41.253542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7e2c-6b75-4da1-acc7-980cae69fa42 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.329142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.329873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.330653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.330825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.331551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.335183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.372555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1125/2253] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:41.373794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.384730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4306-b493-4304-8f41-bba73d5cf035 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.389746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.390357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.390867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.390867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.391516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.393105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.408746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1129/2254] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:41.412822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.426985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8160ba-149f-40de-952f-a7ed28e5eeae admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.435227 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d67ab4-5ba9-4ddc-a0b4-7823a1b62800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.435845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d67ab4-5ba9-4ddc-a0b4-7823a1b62800 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.436122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d67ab4-5ba9-4ddc-a0b4-7823a1b62800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.436679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d67ab4-5ba9-4ddc-a0b4-7823a1b62800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.437371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d67ab4-5ba9-4ddc-a0b4-7823a1b62800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.439297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d67ab4-5ba9-4ddc-a0b4-7823a1b62800 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.455384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1126/2255] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:41.460186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.470884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd3674-e68b-43a7-b0b0-c0822addef3e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.477107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.477884 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.478164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.478438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] PATH_INFO: `/v3/projects/f63e3d0697744e2584a8f83d1f680d47/users/4f207699860c423682e6ce3b85a9aec0/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.495331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63e3d0697744e2584a8f83d1f680d47, user_id=4f207699860c423682e6ce3b85a9aec0, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.498117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.515798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1130/2256] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:41 2022] PUT /identity/v3/projects/f63e3d0697744e2584a8f83d1f680d47/users/4f207699860c423682e6ce3b85a9aec0/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:41.527629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b1d12-ea1c-43da-87f5-66b0a4a55d08 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.528137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b1d12-ea1c-43da-87f5-66b0a4a55d08 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.528620 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b1d12-ea1c-43da-87f5-66b0a4a55d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.560268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3a4b1d12-ea1c-43da-87f5-66b0a4a55d08 None None] MFA Rules not processed for user `4f207699860c423682e6ce3b85a9aec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:41.561652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3a4b1d12-ea1c-43da-87f5-66b0a4a55d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:41.647630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1127/2257] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:41.652204 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.724324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93efbe9-a60a-457d-a714-9804fe8da4dc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.729979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.730587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.730865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.731137 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.731762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.733771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.764743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1131/2258] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:41.766116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b1d12-ea1c-43da-87f5-66b0a4a55d08 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.778029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b1d12-ea1c-43da-87f5-66b0a4a55d08 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.835878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.836485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.836762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.837024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.837705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.839618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.865435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1128/2259] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:41.870373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.883768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16b1e9-f9a9-4cad-be59-4c1a29120a41 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.892734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e61998-e16a-44d9-aca5-f7d896fe1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.893181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61998-e16a-44d9-aca5-f7d896fe1096 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.893469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61998-e16a-44d9-aca5-f7d896fe1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.893765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61998-e16a-44d9-aca5-f7d896fe1096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.894425 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e61998-e16a-44d9-aca5-f7d896fe1096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.896209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e61998-e16a-44d9-aca5-f7d896fe1096 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.912449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1132/2260] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:41.914505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:41.920283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:41.938116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2adad-de64-4606-953e-37cc0fb64014 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:41.957265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:41.957914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.958230 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.958463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] PATH_INFO: `/v3/projects/ec791c181ed54a7985af7578c3969d23/users/71335df228574edfb5ba2e63f4186aa2/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.958833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:41.959503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:41.960055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:41.979593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec791c181ed54a7985af7578c3969d23, user_id=71335df228574edfb5ba2e63f4186aa2, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:41.983710 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:41.996720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] MFA Rules not processed for user `50eea739d1064348a2adcd4c5ba0b180`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:41.997877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:42.004161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1129/2261] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:41 2022] PUT /identity/v3/projects/ec791c181ed54a7985af7578c3969d23/users/71335df228574edfb5ba2e63f4186aa2/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:42.008825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:42.048986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:42.095104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1133/2262] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:42.104311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5630e7-2a20-46cb-a563-312338cd2bdc admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:42.107161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:42.108651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:42.114708 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:42.117040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.117397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.119250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.120463 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:42.126826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:42.141428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1130/2263] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:42.143095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:42.157553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b9a71-a237-451c-bd97-5c4cd773c23f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:42.163321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cc9bb-7bcf-4974-b2c3-08f873d2527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:42.164091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc9bb-7bcf-4974-b2c3-08f873d2527e admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.164568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc9bb-7bcf-4974-b2c3-08f873d2527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.164909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc9bb-7bcf-4974-b2c3-08f873d2527e admin admin] PATH_INFO: `/v3/projects/ec791c181ed54a7985af7578c3969d23/users/71335df228574edfb5ba2e63f4186aa2/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.169325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cc9bb-7bcf-4974-b2c3-08f873d2527e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec791c181ed54a7985af7578c3969d23, user_id=71335df228574edfb5ba2e63f4186aa2, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:42.169971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cc9bb-7bcf-4974-b2c3-08f873d2527e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:42.174877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54b22a-d487-4996-8f80-e9e2a5aa9f4c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:42.179854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:42.180494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.180767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.181090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.182888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1131/2264] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:42 2022] PUT /identity/v3/projects/ec791c181ed54a7985af7578c3969d23/users/71335df228574edfb5ba2e63f4186aa2/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:42.193028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98a52-60ee-4620-bb84-d19241a01a76 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.193648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98a52-60ee-4620-bb84-d19241a01a76 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.194216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98a52-60ee-4620-bb84-d19241a01a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.195702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:42.197298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:42.207409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1134/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:42.229969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4ce98a52-60ee-4620-bb84-d19241a01a76 None None] MFA Rules not processed for user `71335df228574edfb5ba2e63f4186aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:42.231269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4ce98a52-60ee-4620-bb84-d19241a01a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:42.306780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1132/2266] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:42.317901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:42.319978 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:42.331533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897330-0be1-4346-b368-ec0fb0212370 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:42.391531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d6b24-c2c7-4f24-97a6-4b667b332558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:42.392217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d6b24-c2c7-4f24-97a6-4b667b332558 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.392500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d6b24-c2c7-4f24-97a6-4b667b332558 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.392774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d6b24-c2c7-4f24-97a6-4b667b332558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.403360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d6b24-c2c7-4f24-97a6-4b667b332558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:42.404933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d6b24-c2c7-4f24-97a6-4b667b332558 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:42.414988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1135/2267] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:42.469421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98a52-60ee-4620-bb84-d19241a01a76 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:42.482369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98a52-60ee-4620-bb84-d19241a01a76 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:42.488504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8e90-fbfb-4462-9790-e8954e7ca6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:42.489502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8e90-fbfb-4462-9790-e8954e7ca6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:42.489968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8e90-fbfb-4462-9790-e8954e7ca6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:42.490976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8e90-fbfb-4462-9790-e8954e7ca6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:42.545372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:42.561659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8e90-fbfb-4462-9790-e8954e7ca6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:42.563767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8e90-fbfb-4462-9790-e8954e7ca6f9 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:42.573321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1133/2268] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:43.598828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d054e-eb45-4727-93ba-6ac725436634 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.599307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d054e-eb45-4727-93ba-6ac725436634 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.599689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d054e-eb45-4727-93ba-6ac725436634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.622030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-791d054e-eb45-4727-93ba-6ac725436634 None None] MFA Rules not processed for user `50eea739d1064348a2adcd4c5ba0b180`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:43.623249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-791d054e-eb45-4727-93ba-6ac725436634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:43.687225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1136/2269] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:43.705199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4813c3-0ad5-47f2-8c63-376583dc9b52 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.705621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4813c3-0ad5-47f2-8c63-376583dc9b52 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.705818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4813c3-0ad5-47f2-8c63-376583dc9b52 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.707352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1134/2270] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:57:43.737634 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.738382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.738382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.765263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] MFA Rules not processed for user `cc9135818040417292f1f2bcb588a105`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:43.765947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:43.785663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:43.843572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1137/2271] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:43.866091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4813c3-0ad5-47f2-8c63-376583dc9b52 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:43.868033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ce4813c3-0ad5-47f2-8c63-376583dc9b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:43.889477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4813c3-0ad5-47f2-8c63-376583dc9b52 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:43.897099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:43.898010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:43.898363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:43.898705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:43.908715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:43.910479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:43.922420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1135/2272] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:44.455359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:44.456893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:44.559740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b0117-9bf7-4f3c-ba35-f7f960bf3de4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:44.564824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:44.565619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:44.566021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:44.566565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] PATH_INFO: `/v3/users/fc95834a9ed14992ae1ced52824ce880` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:44.574467 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc95834a9ed14992ae1ced52824ce880)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:44.577700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:44.667870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc95834a9ed14992ae1ced52824ce880'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:44.713301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc95834a9ed14992ae1ced52824ce880'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:44.713301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc95834a9ed14992ae1ced52824ce880'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:44.730555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc95834a9ed14992ae1ced52824ce880'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:44.748913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc95834a9ed14992ae1ced52824ce880'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:44.770633 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1138/2273] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:44 2022] DELETE /identity/v3/users/fc95834a9ed14992ae1ced52824ce880 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:44.986818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:45.000279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ee1f0-1389-44e9-9883-0c495da0a9b1 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:45.079785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:45.080420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.080700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.081254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] PATH_INFO: `/v3/projects/eb758e92e01342c89c14267d3cd55cf6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.082400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb758e92e01342c89c14267d3cd55cf6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:45.084961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:45.139118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb758e92e01342c89c14267d3cd55cf6', 'request_id': 'req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.147115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb758e92e01342c89c14267d3cd55cf6', 'request_id': 'req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.152813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb758e92e01342c89c14267d3cd55cf6', 'request_id': 'req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.163929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] The token cache is being invalidate because project eb758e92e01342c89c14267d3cd55cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:45.164200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.164845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.166386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1136/2274] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:44 2022] DELETE /identity/v3/projects/eb758e92e01342c89c14267d3cd55cf6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:45.171340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:45.172788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:45.188041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef281ff-03bd-4202-b564-9c58fd7a5bdb admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:45.226287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:45.252689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:45.253418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.253699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.253948 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] PATH_INFO: `/v3/users/49bd6aed4f3c4fe98aae6a442fd3af68` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.255071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bd6aed4f3c4fe98aae6a442fd3af68)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:45.257992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:45.306517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bd6aed4f3c4fe98aae6a442fd3af68'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.313606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bd6aed4f3c4fe98aae6a442fd3af68'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.314213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bd6aed4f3c4fe98aae6a442fd3af68'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.326485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bd6aed4f3c4fe98aae6a442fd3af68'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.333263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-1db5a93c-a3d2-45fe-866c-6a9f6806e547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bd6aed4f3c4fe98aae6a442fd3af68'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.340401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1139/2275] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:45 2022] DELETE /identity/v3/users/49bd6aed4f3c4fe98aae6a442fd3af68 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:45.526695 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:45.528289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:45.542936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeca1c-5dff-4c68-9f1f-53d359d10c6f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:45.614490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:45.615116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.615454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.615716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] PATH_INFO: `/v3/projects/9534a953a2264a8e9f3751e29310e3a5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.616839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9534a953a2264a8e9f3751e29310e3a5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:45.618794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:45.621047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:45.670374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9534a953a2264a8e9f3751e29310e3a5', 'request_id': 'req-33558d04-d41a-4b6b-bcdb-b78dce1694ff'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.677879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9534a953a2264a8e9f3751e29310e3a5', 'request_id': 'req-33558d04-d41a-4b6b-bcdb-b78dce1694ff'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.684398 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9534a953a2264a8e9f3751e29310e3a5', 'request_id': 'req-33558d04-d41a-4b6b-bcdb-b78dce1694ff'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.696401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] The token cache is being invalidate because project 9534a953a2264a8e9f3751e29310e3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:45.696686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.697361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-33558d04-d41a-4b6b-bcdb-b78dce1694ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:45.698850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1137/2276] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:45 2022] DELETE /identity/v3/projects/9534a953a2264a8e9f3751e29310e3a5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:45.705450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197be41-012e-42e0-939a-87a974616edd None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.705940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197be41-012e-42e0-939a-87a974616edd None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.706033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197be41-012e-42e0-939a-87a974616edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.728033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1197be41-012e-42e0-939a-87a974616edd None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:45.729182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1197be41-012e-42e0-939a-87a974616edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:45.789746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1140/2277] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:45.798084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc4a74-0c07-4443-b82c-d73225ffb5c5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.798703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc4a74-0c07-4443-b82c-d73225ffb5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.799107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc4a74-0c07-4443-b82c-d73225ffb5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.824376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2ddc4a74-0c07-4443-b82c-d73225ffb5c5 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:45.825723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2ddc4a74-0c07-4443-b82c-d73225ffb5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:45.833883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1138/2278] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:45.838154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197be41-012e-42e0-939a-87a974616edd None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:45.848148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197be41-012e-42e0-939a-87a974616edd None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:45.853239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:45.853914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.854192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.854463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.855119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:45.855415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:45.857035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:45.870056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1141/2279] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:45.874647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc4a74-0c07-4443-b82c-d73225ffb5c5 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:45.886331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc4a74-0c07-4443-b82c-d73225ffb5c5 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:45.891341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:45.892142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:45.892454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:45.892703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:45.894421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:45.896074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:45.932408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1139/2280] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:45 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:45.936571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:45.948260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cee7-bca0-4868-a4fa-588b92b7dbef admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:46.017657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:46.037862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:46.038642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.038926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.039203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.039920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:46.041950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:46.085580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:46.087770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1142/2281] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:45 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:46.097743 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316a866-dac5-4675-a1b6-cff1950f73e3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:46.104542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:46.105449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.105900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.106321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.108565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:46.110681 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:46.125020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1140/2282] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:46.130710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:46.144150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd743fa-26af-4e4b-b69f-975e69146d3a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:46.150264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ae26-5a41-478d-838c-9d1988538776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:46.151065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ae26-5a41-478d-838c-9d1988538776 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.151347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ae26-5a41-478d-838c-9d1988538776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.151621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ae26-5a41-478d-838c-9d1988538776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.152426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ae26-5a41-478d-838c-9d1988538776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:46.154329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ae26-5a41-478d-838c-9d1988538776 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:46.169196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1143/2283] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:46.172556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:46.188762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0734c10-dd82-4277-882f-411dcdc586b5 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:46.195737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:46.196565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.196948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.197107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] PATH_INFO: `/v3/projects/87778f1069904fc28c0c4b208bb8bc39/users/83f2a49836ae4300bf170d839a0d6398/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.220269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87778f1069904fc28c0c4b208bb8bc39, user_id=83f2a49836ae4300bf170d839a0d6398, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:46.224183 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:46.245278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1141/2284] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:46 2022] PUT /identity/v3/projects/87778f1069904fc28c0c4b208bb8bc39/users/83f2a49836ae4300bf170d839a0d6398/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:46.256149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.256431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.256709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.292478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:46.294245 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] MFA Rules not processed for user `83f2a49836ae4300bf170d839a0d6398`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:46.294607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:46.295783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:46.381756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac9ac-866e-456a-830b-c2e9297aa27e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:46.384420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1144/2285] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:46.389977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:46.390640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.390991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.391334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] PATH_INFO: `/v3/users/4f207699860c423682e6ce3b85a9aec0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.392909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f207699860c423682e6ce3b85a9aec0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:46.395193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:46.395958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:46.398646 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:46.436794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:46.456049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f207699860c423682e6ce3b85a9aec0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:46.469654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f207699860c423682e6ce3b85a9aec0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:46.482143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f207699860c423682e6ce3b85a9aec0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:46.482639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f207699860c423682e6ce3b85a9aec0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:46.491588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ac686f0c-57f6-4151-a76c-fd5f9a246872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f207699860c423682e6ce3b85a9aec0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:46.498663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1142/2286] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:46 2022] DELETE /identity/v3/users/4f207699860c423682e6ce3b85a9aec0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:46.498814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c549bb-da4b-4118-9477-376817fb9229 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:46.502894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849df1-a349-445a-a470-45314ddf655f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.503075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849df1-a349-445a-a470-45314ddf655f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.503333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849df1-a349-445a-a470-45314ddf655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.523092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2b849df1-a349-445a-a470-45314ddf655f None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:46.523910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2b849df1-a349-445a-a470-45314ddf655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:46.552708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:46.560334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:46.561207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.563409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.564678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.571348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:46.593234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1143/2287] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:46.606897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849df1-a349-445a-a470-45314ddf655f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:46.608428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2b849df1-a349-445a-a470-45314ddf655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:46.642163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:46.643593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:46.658384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1145/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:46.686699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849df1-a349-445a-a470-45314ddf655f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:46.691839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:46.692889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:46.692889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:46.692889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:46.706338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:46.707975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:46.719286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1144/2289] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:47.034997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.036543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:47.055444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4031fe-6da5-483d-8ae9-8b1474d1985d service glance] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.062140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.062967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.063497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.063766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] PATH_INFO: `/v3/projects/f63e3d0697744e2584a8f83d1f680d47` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.065317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63e3d0697744e2584a8f83d1f680d47)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.067363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.129850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63e3d0697744e2584a8f83d1f680d47', 'request_id': 'req-ceecc642-64bc-441d-9ee2-1129e15b3905'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.138838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63e3d0697744e2584a8f83d1f680d47', 'request_id': 'req-ceecc642-64bc-441d-9ee2-1129e15b3905'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.146171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63e3d0697744e2584a8f83d1f680d47', 'request_id': 'req-ceecc642-64bc-441d-9ee2-1129e15b3905'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.158558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] The token cache is being invalidate because project f63e3d0697744e2584a8f83d1f680d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:47.159018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.159700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.161803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1146/2290] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:47 2022] DELETE /identity/v3/projects/f63e3d0697744e2584a8f83d1f680d47 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:47.167426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.180668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383d8d7-74d0-4e5d-b10a-ccbed4b35af1 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.239617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.259297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.260034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.260519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.260965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] PATH_INFO: `/v3/users/71335df228574edfb5ba2e63f4186aa2` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.262877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71335df228574edfb5ba2e63f4186aa2)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.266226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.358267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71335df228574edfb5ba2e63f4186aa2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.375321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71335df228574edfb5ba2e63f4186aa2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.383929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71335df228574edfb5ba2e63f4186aa2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.384692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71335df228574edfb5ba2e63f4186aa2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.394004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-28e31786-f22d-46c7-8d6f-f95b5f1751e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71335df228574edfb5ba2e63f4186aa2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.401454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1145/2291] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:47 2022] DELETE /identity/v3/users/71335df228574edfb5ba2e63f4186aa2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:47.702511 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:47.704592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:47.720583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecc642-64bc-441d-9ee2-1129e15b3905 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:47.793961 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:47.794579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.795014 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.795352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] PATH_INFO: `/v3/projects/ec791c181ed54a7985af7578c3969d23` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.796667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec791c181ed54a7985af7578c3969d23)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:47.799246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:47.839066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:47.863440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec791c181ed54a7985af7578c3969d23', 'request_id': 'req-39894bcc-0e5d-494f-a66e-6f2009641dc6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.885297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec791c181ed54a7985af7578c3969d23', 'request_id': 'req-39894bcc-0e5d-494f-a66e-6f2009641dc6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.893178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec791c181ed54a7985af7578c3969d23', 'request_id': 'req-39894bcc-0e5d-494f-a66e-6f2009641dc6'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.905850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] The token cache is being invalidate because project ec791c181ed54a7985af7578c3969d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:47.906138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.909789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-39894bcc-0e5d-494f-a66e-6f2009641dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:47.911825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1147/2292] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:47 2022] DELETE /identity/v3/projects/ec791c181ed54a7985af7578c3969d23 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:47.917361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bf946-0948-4d5c-b529-fcf09366cbdd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:47.917737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bf946-0948-4d5c-b529-fcf09366cbdd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:47.918102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bf946-0948-4d5c-b529-fcf09366cbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:47.938712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-176bf946-0948-4d5c-b529-fcf09366cbdd None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:47.940032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-176bf946-0948-4d5c-b529-fcf09366cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:48.011588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1146/2293] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:48.019593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6d368-c6ea-421f-970e-d0abcbfd9caa None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.019878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6d368-c6ea-421f-970e-d0abcbfd9caa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.020192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6d368-c6ea-421f-970e-d0abcbfd9caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.042064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-2ce6d368-c6ea-421f-970e-d0abcbfd9caa None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:48.043269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2ce6d368-c6ea-421f-970e-d0abcbfd9caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:48.052218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1148/2294] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:48.057935 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bf946-0948-4d5c-b529-fcf09366cbdd None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.070522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bf946-0948-4d5c-b529-fcf09366cbdd None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.075360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.075973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.076246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.076510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.077181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:48.077484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.079061 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.092602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1147/2295] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:48.097078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6d368-c6ea-421f-970e-d0abcbfd9caa None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.106461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6d368-c6ea-421f-970e-d0abcbfd9caa None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.114022 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.114392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.114758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.115788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.117113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.119469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.151176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1149/2296] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:48 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:48.155697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.168117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944a682-32c1-4d6b-95d0-04585b6bac93 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.227653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:48.234812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.235938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.236524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.237104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.237879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.240767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.277590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1148/2297] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:48 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:48.282358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.292901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1fdf6-5440-4df3-bc64-0cf6ff54b5a5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.297582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.298185 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.298453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.298726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.299363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.300940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.316145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1150/2298] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:48.317662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.329885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328948b-73a9-43a0-aadf-3193f7a45e12 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.334414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849134-ef0e-4472-a2db-d4a9a1fa5340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.335606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849134-ef0e-4472-a2db-d4a9a1fa5340 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.335886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849134-ef0e-4472-a2db-d4a9a1fa5340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.336160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849134-ef0e-4472-a2db-d4a9a1fa5340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.336832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44849134-ef0e-4472-a2db-d4a9a1fa5340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.339197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44849134-ef0e-4472-a2db-d4a9a1fa5340 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.351075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1149/2299] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:48.356746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.369642 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f5e5-c1e7-48fe-9be2-b859dd49ae5b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.374777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.375513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.375866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.376213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] PATH_INFO: `/v3/projects/d073fe59d04643ae92bd70387a7b0dd0/users/2f3ab86be9f2468cbe2590375ea1e0e6/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.395406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d073fe59d04643ae92bd70387a7b0dd0, user_id=2f3ab86be9f2468cbe2590375ea1e0e6, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.398343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.412866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1151/2300] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:48 2022] PUT /identity/v3/projects/d073fe59d04643ae92bd70387a7b0dd0/users/2f3ab86be9f2468cbe2590375ea1e0e6/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:48.425580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eb76e-824d-47e3-acb7-1af15f5f3500 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.426720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eb76e-824d-47e3-acb7-1af15f5f3500 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.427131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eb76e-824d-47e3-acb7-1af15f5f3500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.462900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-3d5eb76e-824d-47e3-acb7-1af15f5f3500 None None] MFA Rules not processed for user `2f3ab86be9f2468cbe2590375ea1e0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:48.464145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-3d5eb76e-824d-47e3-acb7-1af15f5f3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:48.548306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1150/2301] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:48.552906 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.622447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8367c13-4dbd-47e2-bf61-832dde2b2317 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.627106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.627713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.627993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.628267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.628898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.631399 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.670186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1152/2302] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:48 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:48.671372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5eb76e-824d-47e3-acb7-1af15f5f3500 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.683108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5eb76e-824d-47e3-acb7-1af15f5f3500 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.741912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.742627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.742977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.743348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.744080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.746156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.769196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1151/2303] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:48 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:48.773588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.784564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc48c29-b8d1-4b9c-840c-37ca2f191407 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.789727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.790451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.790849 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.791220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.791973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.793707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.807080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1153/2304] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:48.810959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.821780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04de85-7195-4bee-b1b3-3ae6fac976c4 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.826491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.827149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.827430 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.827704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] PATH_INFO: `/v3/projects/6eed7dfdc5ad4d8aa54cc78ddf39b478/users/c78c2333a89f4f07b6d65e82b00e5a09/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.845339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eed7dfdc5ad4d8aa54cc78ddf39b478, user_id=c78c2333a89f4f07b6d65e82b00e5a09, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.848020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.863964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1152/2305] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:48 2022] PUT /identity/v3/projects/6eed7dfdc5ad4d8aa54cc78ddf39b478/users/c78c2333a89f4f07b6d65e82b00e5a09/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:48.868636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.883897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42417c-c67d-40c8-ba19-15751051086e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.913508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:48.956861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80d6f-88c9-4b2b-ba64-e602b0a94411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.957492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80d6f-88c9-4b2b-ba64-e602b0a94411 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.957776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80d6f-88c9-4b2b-ba64-e602b0a94411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.958054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80d6f-88c9-4b2b-ba64-e602b0a94411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.958730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80d6f-88c9-4b2b-ba64-e602b0a94411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:48.960625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80d6f-88c9-4b2b-ba64-e602b0a94411 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:48.972340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1154/2306] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:48.976444 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:48.989305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daec9b-3d84-46a0-9a0c-a8d602b31bd6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:48.995617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:48.996301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:48.996603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:48.996876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] PATH_INFO: `/v3/projects/6eed7dfdc5ad4d8aa54cc78ddf39b478/users/c78c2333a89f4f07b6d65e82b00e5a09/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:48.998921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eed7dfdc5ad4d8aa54cc78ddf39b478, user_id=c78c2333a89f4f07b6d65e82b00e5a09, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:49.001610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:49.012734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1153/2307] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:48 2022] PUT /identity/v3/projects/6eed7dfdc5ad4d8aa54cc78ddf39b478/users/c78c2333a89f4f07b6d65e82b00e5a09/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:49.029192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04197b4-75e0-4b09-bf91-1595a7766ff5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:49.033193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04197b4-75e0-4b09-bf91-1595a7766ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:49.033692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04197b4-75e0-4b09-bf91-1595a7766ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:49.078376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e04197b4-75e0-4b09-bf91-1595a7766ff5 None None] MFA Rules not processed for user `c78c2333a89f4f07b6d65e82b00e5a09`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:49.080514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e04197b4-75e0-4b09-bf91-1595a7766ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:49.154969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1155/2308] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:49.166931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:49.169692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:49.190246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:49.230931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f10a80-ff8f-4793-b523-189c72260fd6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:49.234754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:49.235352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:49.235628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:49.235897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:49.245250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:49.246659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:49.256260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1154/2309] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:49.341305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04197b4-75e0-4b09-bf91-1595a7766ff5 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:49.351149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04197b4-75e0-4b09-bf91-1595a7766ff5 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:49.354774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e033-0acf-4435-843b-b16b93a26267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:49.355381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e033-0acf-4435-843b-b16b93a26267 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:49.355658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e033-0acf-4435-843b-b16b93a26267 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:49.356048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e033-0acf-4435-843b-b16b93a26267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:49.422031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913e033-0acf-4435-843b-b16b93a26267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:49.423954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913e033-0acf-4435-843b-b16b93a26267 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:49.436910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1156/2310] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:54.347543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:54.417395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f45eed-fdd4-4d53-a7ae-c1c5e284f609 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:54.423458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:54.424219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.424529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.424906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] PATH_INFO: `/v3/users/2f3ab86be9f2468cbe2590375ea1e0e6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.426081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3ab86be9f2468cbe2590375ea1e0e6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:54.428213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:54.476440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3ab86be9f2468cbe2590375ea1e0e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:54.488654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3ab86be9f2468cbe2590375ea1e0e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:54.496499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3ab86be9f2468cbe2590375ea1e0e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:54.497302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3ab86be9f2468cbe2590375ea1e0e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:54.504226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3ab86be9f2468cbe2590375ea1e0e6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:54.510902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1155/2311] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:54 2022] DELETE /identity/v3/users/2f3ab86be9f2468cbe2590375ea1e0e6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:54.515437 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.515969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.515969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.535195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:54.536416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:54.578522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:54.596241 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1157/2312] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:54.607781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:54.609224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:54.656462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:54.673212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac320e-ba10-4775-afb6-1788329a2e8b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:54.676892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:54.677529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:54.677850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:54.678084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:54.687148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:54.688594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:54.699686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1156/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:55.092551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.093778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:55.107253 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5636e5-1841-4a31-b7d0-67451ae40a05 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.113573 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.114289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.114632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.114962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] PATH_INFO: `/v3/projects/d073fe59d04643ae92bd70387a7b0dd0` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.116206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d073fe59d04643ae92bd70387a7b0dd0)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.118235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.167459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd073fe59d04643ae92bd70387a7b0dd0', 'request_id': 'req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.176414 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd073fe59d04643ae92bd70387a7b0dd0', 'request_id': 'req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.183066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd073fe59d04643ae92bd70387a7b0dd0', 'request_id': 'req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.194861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] The token cache is being invalidate because project d073fe59d04643ae92bd70387a7b0dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:55.195149 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.195799 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.197754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1158/2314] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:55 2022] DELETE /identity/v3/projects/d073fe59d04643ae92bd70387a7b0dd0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:55.201715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.211835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977a25d-94a6-4ac3-822e-57c9002ce97c service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.268246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.268863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.269163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.269465 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] PATH_INFO: `/v3/users/c78c2333a89f4f07b6d65e82b00e5a09` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.270546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78c2333a89f4f07b6d65e82b00e5a09)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.273234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.323938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78c2333a89f4f07b6d65e82b00e5a09'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.338274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78c2333a89f4f07b6d65e82b00e5a09'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.346621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78c2333a89f4f07b6d65e82b00e5a09'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.347527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78c2333a89f4f07b6d65e82b00e5a09'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.355075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-82305459-2631-456a-95a1-0003406eb9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78c2333a89f4f07b6d65e82b00e5a09'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.365163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1157/2315] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:55 2022] DELETE /identity/v3/users/c78c2333a89f4f07b6d65e82b00e5a09 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:55.660058 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.662323 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:55.681855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7766e8-7cdb-483d-9c63-1b4dd392a4d2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.744572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.745242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.745583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.745800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] PATH_INFO: `/v3/projects/6eed7dfdc5ad4d8aa54cc78ddf39b478` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.746920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eed7dfdc5ad4d8aa54cc78ddf39b478)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.748839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:55.801133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eed7dfdc5ad4d8aa54cc78ddf39b478', 'request_id': 'req-0e302311-ab8f-4e5f-9911-35f0de8e1677'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.811670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eed7dfdc5ad4d8aa54cc78ddf39b478', 'request_id': 'req-0e302311-ab8f-4e5f-9911-35f0de8e1677'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.817977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eed7dfdc5ad4d8aa54cc78ddf39b478', 'request_id': 'req-0e302311-ab8f-4e5f-9911-35f0de8e1677'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.827038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.831614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] The token cache is being invalidate because project 6eed7dfdc5ad4d8aa54cc78ddf39b478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:55.832020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.833132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0e302311-ab8f-4e5f-9911-35f0de8e1677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:55.838484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1159/2316] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:55 2022] DELETE /identity/v3/projects/6eed7dfdc5ad4d8aa54cc78ddf39b478 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:55.840014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c9e26-3d15-4eb0-a660-07adccaf0049 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.840407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c9e26-3d15-4eb0-a660-07adccaf0049 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.840744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c9e26-3d15-4eb0-a660-07adccaf0049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.862664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7a2c9e26-3d15-4eb0-a660-07adccaf0049 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:55.863865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7a2c9e26-3d15-4eb0-a660-07adccaf0049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:55.925424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1158/2317] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:57:55.934910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde1174-7a3d-4fda-b38d-165ee2295093 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.935226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde1174-7a3d-4fda-b38d-165ee2295093 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.935504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde1174-7a3d-4fda-b38d-165ee2295093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.956945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ddde1174-7a3d-4fda-b38d-165ee2295093 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:55.958272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ddde1174-7a3d-4fda-b38d-165ee2295093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:55.966463 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1160/2318] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:55.970865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c9e26-3d15-4eb0-a660-07adccaf0049 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:55.976283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:55.982656 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c9e26-3d15-4eb0-a660-07adccaf0049 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:55.988775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:55.989407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:55.989692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:55.989961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:55.991170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:55.991471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:55.993091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.005114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1159/2319] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:56.010516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde1174-7a3d-4fda-b38d-165ee2295093 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.020700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde1174-7a3d-4fda-b38d-165ee2295093 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.026154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.026754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.027030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.027301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.027938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.029862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.062390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1161/2320] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:56 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:56.063472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.074839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b347879-6c04-4e66-965d-e72d8e62dee7 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.140346 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.141091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.141481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.141826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.142556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.144639 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.167584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1160/2321] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:56 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:57:56.171539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.182503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f53d4-eedb-4f42-9c13-5f32dbdaa71b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.189433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.190057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.190336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.190609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.191462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.193050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.205755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1162/2322] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:56.211189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.224009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e682-81c7-4a83-a919-d112ac8290c1 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.230137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db046c-49dc-42b4-850f-0e52c98eb414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.230738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db046c-49dc-42b4-850f-0e52c98eb414 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.231011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db046c-49dc-42b4-850f-0e52c98eb414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.231370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db046c-49dc-42b4-850f-0e52c98eb414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.231908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db046c-49dc-42b4-850f-0e52c98eb414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.233586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db046c-49dc-42b4-850f-0e52c98eb414 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.245794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1161/2323] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:57:56.249433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.261113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ad988-4f10-43cc-afb9-7ca7bac3bad5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.265830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.266485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.266762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.267037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] PATH_INFO: `/v3/projects/7a7e4d17977d44f0a5c3ea937046ad6a/users/6049f8594d9d40e5b5a9f078a0478b08/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.285091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7e4d17977d44f0a5c3ea937046ad6a, user_id=6049f8594d9d40e5b5a9f078a0478b08, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.288069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.300550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1163/2324] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:56 2022] PUT /identity/v3/projects/7a7e4d17977d44f0a5c3ea937046ad6a/users/6049f8594d9d40e5b5a9f078a0478b08/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:56.311529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92624-c87b-4b5e-97c1-0060f82d04de None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.311898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92624-c87b-4b5e-97c1-0060f82d04de None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.312175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92624-c87b-4b5e-97c1-0060f82d04de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.340641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0fe92624-c87b-4b5e-97c1-0060f82d04de None None] MFA Rules not processed for user `6049f8594d9d40e5b5a9f078a0478b08`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:56.341886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0fe92624-c87b-4b5e-97c1-0060f82d04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:56.409379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1162/2325] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:56.412099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.475976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca577-05f8-4452-9789-7adae84b4da4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.480700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.481349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.481630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.481904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.482578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.484468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.513337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1164/2326] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:56.517461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92624-c87b-4b5e-97c1-0060f82d04de None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.528540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92624-c87b-4b5e-97c1-0060f82d04de None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.588380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.595632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.596254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.596762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.597036 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.597784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.600334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.622290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1163/2327] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:56 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:56.626322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.640488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073176a-5ee4-4c04-a73d-3a868fb11963 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.645350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.645968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.646243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.648166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.648517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.650429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.675159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1165/2328] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:56.680083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.695394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74657599-c8f3-4ca8-ac31-696fb3a6d657 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.701848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.702707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.703089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.703429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] PATH_INFO: `/v3/projects/a55e566ccace49cfbe029ee3b17f71d1/users/4cc8425c7e014c51aaf60d4d4749596d/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.723538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55e566ccace49cfbe029ee3b17f71d1, user_id=4cc8425c7e014c51aaf60d4d4749596d, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.726537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.744372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1164/2329] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:56 2022] PUT /identity/v3/projects/a55e566ccace49cfbe029ee3b17f71d1/users/4cc8425c7e014c51aaf60d4d4749596d/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:56.748433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.759401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c00e-2ebf-42c0-9800-b74ddb7561e6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.816864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efcc96-8cd6-452a-923c-456471768308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.817574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efcc96-8cd6-452a-923c-456471768308 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.818017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efcc96-8cd6-452a-923c-456471768308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.818719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efcc96-8cd6-452a-923c-456471768308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.819550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efcc96-8cd6-452a-923c-456471768308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.821285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efcc96-8cd6-452a-923c-456471768308 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.831248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1166/2330] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:56.836320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:56.847905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ad092-2f00-42e0-825b-53c9c994327d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:56.855008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:56.855916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.856267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.856612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] PATH_INFO: `/v3/projects/a55e566ccace49cfbe029ee3b17f71d1/users/4cc8425c7e014c51aaf60d4d4749596d/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.859189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55e566ccace49cfbe029ee3b17f71d1, user_id=4cc8425c7e014c51aaf60d4d4749596d, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:56.862372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:56.874230 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1165/2331] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:56 2022] PUT /identity/v3/projects/a55e566ccace49cfbe029ee3b17f71d1/users/4cc8425c7e014c51aaf60d4d4749596d/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:57:56.885735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc146-ccf3-49c0-88eb-4e0088a19ab2 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:56.886028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc146-ccf3-49c0-88eb-4e0088a19ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:56.886305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc146-ccf3-49c0-88eb-4e0088a19ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:56.906581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:56.923522 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-09ebc146-ccf3-49c0-88eb-4e0088a19ab2 None None] MFA Rules not processed for user `4cc8425c7e014c51aaf60d4d4749596d`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:56.924798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-09ebc146-ccf3-49c0-88eb-4e0088a19ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:56.998796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1167/2332] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:57.010260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:57.011973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:57.073051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a1f8-9643-4a51-a9b5-4f681089d643 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:57.076711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204de0-c256-4eac-ae57-d1a7bdc6bdf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:57.077357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204de0-c256-4eac-ae57-d1a7bdc6bdf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.077727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204de0-c256-4eac-ae57-d1a7bdc6bdf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.078005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204de0-c256-4eac-ae57-d1a7bdc6bdf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.088786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204de0-c256-4eac-ae57-d1a7bdc6bdf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:57.090283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204de0-c256-4eac-ae57-d1a7bdc6bdf0 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:57.100212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1166/2333] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:57:57.763406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebc146-ccf3-49c0-88eb-4e0088a19ab2 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:57.828048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebc146-ccf3-49c0-88eb-4e0088a19ab2 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:57.832680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:57.833338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.833631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.834375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] PATH_INFO: `/v3/users/6049f8594d9d40e5b5a9f078a0478b08` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.835885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6049f8594d9d40e5b5a9f078a0478b08)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:57.837895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:57.887811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6049f8594d9d40e5b5a9f078a0478b08'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:57.895221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6049f8594d9d40e5b5a9f078a0478b08'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:57.896041 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6049f8594d9d40e5b5a9f078a0478b08'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:57.917068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6049f8594d9d40e5b5a9f078a0478b08'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:57.924129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6049f8594d9d40e5b5a9f078a0478b08'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:57.931501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1168/2334] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:57 2022] DELETE /identity/v3/users/6049f8594d9d40e5b5a9f078a0478b08 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:57.936220 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:57.936667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:57.936754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:57.958194 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:57.959403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:58.019568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1167/2335] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:58.029984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:58.031441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:58.045077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:58.094596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ebf9-24f5-4ebd-9010-7b8787a5cfb2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:58.098332 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:58.098927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:58.099201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:58.100718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:58.110754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:58.112179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:58.122620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1169/2336] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:57:58.402868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:58.404532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:58.419567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfd25e-a626-4acd-a143-582eceb9b69d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:58.424295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:58.424912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:58.425219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:58.425520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] PATH_INFO: `/v3/projects/7a7e4d17977d44f0a5c3ea937046ad6a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:58.426891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7e4d17977d44f0a5c3ea937046ad6a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:58.429360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:58.479913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:58.481975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7e4d17977d44f0a5c3ea937046ad6a', 'request_id': 'req-ded6a612-4b28-49a1-9600-00ecf9456216'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.491052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7e4d17977d44f0a5c3ea937046ad6a', 'request_id': 'req-ded6a612-4b28-49a1-9600-00ecf9456216'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.497420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7e4d17977d44f0a5c3ea937046ad6a', 'request_id': 'req-ded6a612-4b28-49a1-9600-00ecf9456216'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.509085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] The token cache is being invalidate because project 7a7e4d17977d44f0a5c3ea937046ad6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:58.509411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.510050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.511559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1168/2337] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:58 2022] DELETE /identity/v3/projects/7a7e4d17977d44f0a5c3ea937046ad6a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:58.515542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:58.526085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92353c4-0fe9-434c-a043-f49f9f15765d service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:58.589956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:58.590617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:58.590895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:58.591166 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] PATH_INFO: `/v3/users/4cc8425c7e014c51aaf60d4d4749596d` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:58.592334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc8425c7e014c51aaf60d4d4749596d)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:58.594379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:58.653730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc8425c7e014c51aaf60d4d4749596d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.664255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc8425c7e014c51aaf60d4d4749596d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.664945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc8425c7e014c51aaf60d4d4749596d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.686603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc8425c7e014c51aaf60d4d4749596d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.695662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2324997-6882-4a1a-a180-46b5543ee50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc8425c7e014c51aaf60d4d4749596d'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:58.706460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1170/2338] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:57:58 2022] DELETE /identity/v3/users/4cc8425c7e014c51aaf60d4d4749596d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:59.014166 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.015644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:59.029841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6a612-4b28-49a1-9600-00ecf9456216 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.110806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.111432 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.111707 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.111975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] PATH_INFO: `/v3/projects/a55e566ccace49cfbe029ee3b17f71d1` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.113095 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55e566ccace49cfbe029ee3b17f71d1)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.114999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.164452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55e566ccace49cfbe029ee3b17f71d1', 'request_id': 'req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:59.171840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55e566ccace49cfbe029ee3b17f71d1', 'request_id': 'req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:59.178178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55e566ccace49cfbe029ee3b17f71d1', 'request_id': 'req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:59.189269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] The token cache is being invalidate because project a55e566ccace49cfbe029ee3b17f71d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:57:59.189499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:59.190155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-3b5e4dbd-b5ca-4fc1-9378-782c7ebe408d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:57:59.191645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1169/2339] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:57:59 2022] DELETE /identity/v3/projects/a55e566ccace49cfbe029ee3b17f71d1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:59.197743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9b87-3eb2-4c42-ba82-a011733a30a9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.198219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9b87-3eb2-4c42-ba82-a011733a30a9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.198311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a9b87-3eb2-4c42-ba82-a011733a30a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.219146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3b5a9b87-3eb2-4c42-ba82-a011733a30a9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:59.220397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3b5a9b87-3eb2-4c42-ba82-a011733a30a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:59.253237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:59.286082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1171/2340] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:59.295902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725e67-32c0-4b64-a290-149fdeeb0e3d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.296185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725e67-32c0-4b64-a290-149fdeeb0e3d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.296460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725e67-32c0-4b64-a290-149fdeeb0e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.316988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-80725e67-32c0-4b64-a290-149fdeeb0e3d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:59.318914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-80725e67-32c0-4b64-a290-149fdeeb0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:59.326643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1170/2341] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:59.330981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a9b87-3eb2-4c42-ba82-a011733a30a9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.341578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a9b87-3eb2-4c42-ba82-a011733a30a9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.346691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.347280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.347551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.347816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.348458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:57:59.348757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.350614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.362251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1172/2342] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:57:59.367756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80725e67-32c0-4b64-a290-149fdeeb0e3d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.376873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80725e67-32c0-4b64-a290-149fdeeb0e3d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.382485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.383076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.383364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.383628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.384256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.386155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.414781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1171/2343] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:57:59 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:59.419254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.430568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba9695-8bca-408e-afde-b8588cca5e07 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.492374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.492986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.493369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.493721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.494373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.496475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.519135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1173/2344] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:57:59 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:57:59.523974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.534327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd61c65-5a46-41fc-9b64-291db8039132 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.539091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.539679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.539955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.540225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.540865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.542471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.552207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1172/2345] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:59.557375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.567387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52569-ab10-44bc-98da-a134ab402062 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.572569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c97b7-8cda-44dc-97c0-202c4790c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.573177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c97b7-8cda-44dc-97c0-202c4790c217 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.573470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c97b7-8cda-44dc-97c0-202c4790c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.573741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c97b7-8cda-44dc-97c0-202c4790c217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.574379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c97b7-8cda-44dc-97c0-202c4790c217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.575955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c97b7-8cda-44dc-97c0-202c4790c217 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.587501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1174/2346] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:57:59.591586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.602271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7065fc-26db-4f12-8411-fa31f399a977 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.607299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.608006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.608307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.608579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] PATH_INFO: `/v3/projects/d1b3f54bd77d4c6c8ced03f9c78232c7/users/8a9ee9734d0941e5b36b069a652f188b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.623980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b3f54bd77d4c6c8ced03f9c78232c7, user_id=8a9ee9734d0941e5b36b069a652f188b, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.626706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.640740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1173/2347] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:57:59 2022] PUT /identity/v3/projects/d1b3f54bd77d4c6c8ced03f9c78232c7/users/8a9ee9734d0941e5b36b069a652f188b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:57:59.654916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e72f6-c1fa-4793-acb7-27c175bc31d1 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.655372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e72f6-c1fa-4793-acb7-27c175bc31d1 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.659017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e72f6-c1fa-4793-acb7-27c175bc31d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.690055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-081e72f6-c1fa-4793-acb7-27c175bc31d1 None None] MFA Rules not processed for user `8a9ee9734d0941e5b36b069a652f188b`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:57:59.691275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-081e72f6-c1fa-4793-acb7-27c175bc31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:59.758153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1175/2348] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:57:59.769199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:57:59.770884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:57:59.776821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:59.838179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610185f-1023-4ef2-9bde-e108e1be0a92 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:57:59.841738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f1f5d-04fd-485d-b005-7c1eb84ebd9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:57:59.842467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1f5d-04fd-485d-b005-7c1eb84ebd9b service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:57:59.842823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1f5d-04fd-485d-b005-7c1eb84ebd9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:57:59.843162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1f5d-04fd-485d-b005-7c1eb84ebd9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:57:59.854669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f1f5d-04fd-485d-b005-7c1eb84ebd9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:57:59.856239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f1f5d-04fd-485d-b005-7c1eb84ebd9b service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:57:59.866889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1174/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:01.269861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:01.270391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:01.270504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:01.290047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] MFA Rules not processed for user `8a9ee9734d0941e5b36b069a652f188b`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:01.291275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:01.298525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1176/2350] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:04.786483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db399f-5d70-4683-a42a-a9b3543e8ddf None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:04.787016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db399f-5d70-4683-a42a-a9b3543e8ddf None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:04.787111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db399f-5d70-4683-a42a-a9b3543e8ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:04.807782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c6db399f-5d70-4683-a42a-a9b3543e8ddf None None] MFA Rules not processed for user `50eea739d1064348a2adcd4c5ba0b180`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:04.808980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c6db399f-5d70-4683-a42a-a9b3543e8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:04.866843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1175/2351] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:08.873811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:08.875391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:08.904375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:08.952845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21312e-2cb7-46de-98c2-0bc717b36422 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:08.959319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:08.960362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:08.960667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:08.961567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] PATH_INFO: `/v3/users/83f2a49836ae4300bf170d839a0d6398` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:08.962739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f2a49836ae4300bf170d839a0d6398)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:08.964708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.014542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f2a49836ae4300bf170d839a0d6398'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.023161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f2a49836ae4300bf170d839a0d6398'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.023816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f2a49836ae4300bf170d839a0d6398'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.039786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f2a49836ae4300bf170d839a0d6398'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.048382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f2a49836ae4300bf170d839a0d6398'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.055850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1177/2352] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:08 2022] DELETE /identity/v3/users/83f2a49836ae4300bf170d839a0d6398 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:09.060796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.061625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.061625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.095004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:09.096222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:09.163956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1176/2353] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:09.174629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.176752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:09.245532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a787814-432a-4057-91e8-058854e8d772 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.249171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef526529-a5f3-447f-8b1c-18a7dfd8be94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.249800 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef526529-a5f3-447f-8b1c-18a7dfd8be94 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.250079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef526529-a5f3-447f-8b1c-18a7dfd8be94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.250350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef526529-a5f3-447f-8b1c-18a7dfd8be94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.260829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef526529-a5f3-447f-8b1c-18a7dfd8be94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.262295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef526529-a5f3-447f-8b1c-18a7dfd8be94 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.272663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1178/2354] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:09.737132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:09.737918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:09.751529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6f264-bc21-4fe2-b34e-4bfed0ef5f37 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:09.758353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:09.759108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.759482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.759998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] PATH_INFO: `/v3/projects/87778f1069904fc28c0c4b208bb8bc39` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.761372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87778f1069904fc28c0c4b208bb8bc39)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:09.763559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:09.820658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.824124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87778f1069904fc28c0c4b208bb8bc39', 'request_id': 'req-afe2512a-91cb-4a15-a578-2e079a275680'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.832531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87778f1069904fc28c0c4b208bb8bc39', 'request_id': 'req-afe2512a-91cb-4a15-a578-2e079a275680'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.840225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87778f1069904fc28c0c4b208bb8bc39', 'request_id': 'req-afe2512a-91cb-4a15-a578-2e079a275680'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.852511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] The token cache is being invalidate because project 87778f1069904fc28c0c4b208bb8bc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:09.852834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.853698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-afe2512a-91cb-4a15-a578-2e079a275680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:09.855110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1177/2355] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:09 2022] DELETE /identity/v3/projects/87778f1069904fc28c0c4b208bb8bc39 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:09.860583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598244-0c68-4dde-be74-8baa1ffaf425 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.860866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598244-0c68-4dde-be74-8baa1ffaf425 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.861141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598244-0c68-4dde-be74-8baa1ffaf425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:09.882054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f1598244-0c68-4dde-be74-8baa1ffaf425 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:09.883270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f1598244-0c68-4dde-be74-8baa1ffaf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:09.925636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:09.966669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1179/2356] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:58:09.981459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b447b-b910-41bc-b1d7-0c494f05cf29 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:09.981459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b447b-b910-41bc-b1d7-0c494f05cf29 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:09.981459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b447b-b910-41bc-b1d7-0c494f05cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.007238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d13b447b-b910-41bc-b1d7-0c494f05cf29 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:10.009283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d13b447b-b910-41bc-b1d7-0c494f05cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:10.018399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1178/2357] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:10.023628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598244-0c68-4dde-be74-8baa1ffaf425 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.035583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598244-0c68-4dde-be74-8baa1ffaf425 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.041454 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.042334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.042708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.043076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.044084 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:10.044541 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.046551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.061513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1180/2358] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:10.065511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b447b-b910-41bc-b1d7-0c494f05cf29 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.078175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b447b-b910-41bc-b1d7-0c494f05cf29 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.085222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.085671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.085944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.086208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.086849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.088853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.120222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1179/2359] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:10.138481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.150162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183522e-310c-43e5-892b-ffe40988cd31 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.217589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.218318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.218689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.219044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.219789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.222279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.268395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1181/2360] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:10.273079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.287971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb176da-e6d9-4c2b-b9a2-30884e892fa1 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.293961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.294766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.295223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.295569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.296492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.298102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.320621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1180/2361] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:10.325028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.335680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418ea8b-6959-4595-b664-2b6d3844dea7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.340510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df901c87-67df-4fe1-83a2-40e0ef49e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.341108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df901c87-67df-4fe1-83a2-40e0ef49e950 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.341443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df901c87-67df-4fe1-83a2-40e0ef49e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.341722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df901c87-67df-4fe1-83a2-40e0ef49e950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.342381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df901c87-67df-4fe1-83a2-40e0ef49e950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.344471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df901c87-67df-4fe1-83a2-40e0ef49e950 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.359224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1182/2362] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:10.363762 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.374742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d01515-a100-4e7a-8635-ed33f6481744 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.381011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.382589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.382990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.383382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] PATH_INFO: `/v3/projects/9878f45a8cca48cb80ea31c728d33d2b/users/e369418b0abe47e994ca83865ec699c3/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.400029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9878f45a8cca48cb80ea31c728d33d2b, user_id=e369418b0abe47e994ca83865ec699c3, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.402817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.416675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1181/2363] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:10 2022] PUT /identity/v3/projects/9878f45a8cca48cb80ea31c728d33d2b/users/e369418b0abe47e994ca83865ec699c3/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:10.429208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0212-c7a2-4f31-b521-7bdec5646139 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.429495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0212-c7a2-4f31-b521-7bdec5646139 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.429768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0212-c7a2-4f31-b521-7bdec5646139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.458415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c51d0212-c7a2-4f31-b521-7bdec5646139 None None] MFA Rules not processed for user `e369418b0abe47e994ca83865ec699c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:10.460790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c51d0212-c7a2-4f31-b521-7bdec5646139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:10.529477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1183/2364] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:58:10.534107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.607979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c0b03-964a-4144-80d0-16454118aff4 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.612904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.613698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.613978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.614276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.615527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.617565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.647360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1182/2365] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:10.651472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d0212-c7a2-4f31-b521-7bdec5646139 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.663324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d0212-c7a2-4f31-b521-7bdec5646139 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.703904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.723898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.724731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.725071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.725442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.726144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.728141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.751725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1184/2366] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:10.757009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.772248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9e32e-36c3-476d-a228-a45eeb59b2f9 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.777431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.778063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.778395 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.778674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.779618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.781236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.794912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1183/2367] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:10.798870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.808723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1c171-f8d7-4893-8c4f-d3d0e6c085a5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.813402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece611f-a37b-45b2-b84b-01952468acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.813999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece611f-a37b-45b2-b84b-01952468acdf admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.814277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece611f-a37b-45b2-b84b-01952468acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.814545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece611f-a37b-45b2-b84b-01952468acdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.815182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece611f-a37b-45b2-b84b-01952468acdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.816806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece611f-a37b-45b2-b84b-01952468acdf admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.826881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1185/2368] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:10.831599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:10.842921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b1c66-83cf-480a-9d1e-d167b83ccd47 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:10.848331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:10.849077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.850353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.850693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] PATH_INFO: `/v3/projects/0cdbcc110b57478da8b1d174347377bb/users/c61b763d2da54626a029bac9288dae83/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.867366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdbcc110b57478da8b1d174347377bb, user_id=c61b763d2da54626a029bac9288dae83, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:10.870045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:10.883856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1184/2369] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:10 2022] PUT /identity/v3/projects/0cdbcc110b57478da8b1d174347377bb/users/c61b763d2da54626a029bac9288dae83/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:10.894182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219dfa9-a738-4e53-baad-91ffba840022 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:10.894671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219dfa9-a738-4e53-baad-91ffba840022 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:10.894763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219dfa9-a738-4e53-baad-91ffba840022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:10.923762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9219dfa9-a738-4e53-baad-91ffba840022 None None] MFA Rules not processed for user `c61b763d2da54626a029bac9288dae83`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:10.925060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9219dfa9-a738-4e53-baad-91ffba840022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:10.988741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1186/2370] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:10.995322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.018453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.064572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245bf1b-044e-4420-809c-d3defd559d4b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.069943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.070546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.070866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.071096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.072286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.074099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.103335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1185/2371] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:10 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:11.107263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219dfa9-a738-4e53-baad-91ffba840022 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.119083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219dfa9-a738-4e53-baad-91ffba840022 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.180516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.181032 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.181617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.181890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.182883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.184433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.207271 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1187/2372] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:11 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:11.211899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.222356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a09fe-97c8-4975-b014-a54120148d30 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.227796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.228443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.228727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.229034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.229757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.231380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.243593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1186/2373] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:11.248274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.258878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ae8e-156b-436a-9c77-678e2801134a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.263601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.264248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.264532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.264808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] PATH_INFO: `/v3/projects/53e585fc86a841048200a66458c8a07a/users/4e6ae6d282b84908942815486ffa06f0/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.280554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e585fc86a841048200a66458c8a07a, user_id=4e6ae6d282b84908942815486ffa06f0, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.283260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.297585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1188/2374] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:11 2022] PUT /identity/v3/projects/53e585fc86a841048200a66458c8a07a/users/4e6ae6d282b84908942815486ffa06f0/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:11.301507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.328846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e2c21-c6a0-45fc-bf13-336595dbf479 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.388628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605980-7ccc-472d-af21-69e8ad9c83bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.389260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605980-7ccc-472d-af21-69e8ad9c83bf admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.389540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605980-7ccc-472d-af21-69e8ad9c83bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.389805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605980-7ccc-472d-af21-69e8ad9c83bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.390439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605980-7ccc-472d-af21-69e8ad9c83bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.392015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605980-7ccc-472d-af21-69e8ad9c83bf admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.402661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1187/2375] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:11.406779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.417140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101965c4-678e-49ec-88be-75d8d528c51e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.422789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.423472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.423736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.424076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] PATH_INFO: `/v3/projects/53e585fc86a841048200a66458c8a07a/users/4e6ae6d282b84908942815486ffa06f0/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.426540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e585fc86a841048200a66458c8a07a, user_id=4e6ae6d282b84908942815486ffa06f0, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.430122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.437282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:11.442971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1189/2376] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:11 2022] PUT /identity/v3/projects/53e585fc86a841048200a66458c8a07a/users/4e6ae6d282b84908942815486ffa06f0/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:11.453833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b1dd8-77d2-4125-bb7f-ae2f7f088b87 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.453833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b1dd8-77d2-4125-bb7f-ae2f7f088b87 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.454035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b1dd8-77d2-4125-bb7f-ae2f7f088b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.485662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-0e8b1dd8-77d2-4125-bb7f-ae2f7f088b87 None None] MFA Rules not processed for user `4e6ae6d282b84908942815486ffa06f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:11.487202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0e8b1dd8-77d2-4125-bb7f-ae2f7f088b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:11.562275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1188/2377] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:11.574601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:11.576496 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:11.640812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15d3f-7c66-48e5-92cd-de4bfd77961a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:11.644974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:11.645616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:11.645897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:11.646675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:11.721008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:11.722686 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:11.732699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1190/2378] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:12.720505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cce10-46bd-4b78-9df7-41ae3eb1c58a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:12.721069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cce10-46bd-4b78-9df7-41ae3eb1c58a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:12.721069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cce10-46bd-4b78-9df7-41ae3eb1c58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:12.740694 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-449cce10-46bd-4b78-9df7-41ae3eb1c58a None None] MFA Rules not processed for user `9cba47a204da4d49b6e6313052f4c579`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:12.741929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-449cce10-46bd-4b78-9df7-41ae3eb1c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:12.750878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:12.799268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1189/2379] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:13.277401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:13.278987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:13.289994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f2165-2f90-4d84-b403-b0bce58387df service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:13.293669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:13.294170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:13.294450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:13.294719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:13.354026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:13.355473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:13.365403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1191/2380] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:14.218842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cce10-46bd-4b78-9df7-41ae3eb1c58a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:14.231320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cce10-46bd-4b78-9df7-41ae3eb1c58a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:14.240721 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ff1d-da0c-4a09-8d58-28fb99cc14ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:14.241752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ff1d-da0c-4a09-8d58-28fb99cc14ae service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:14.242779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ff1d-da0c-4a09-8d58-28fb99cc14ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:14.243203 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ff1d-da0c-4a09-8d58-28fb99cc14ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:14.261971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ff1d-da0c-4a09-8d58-28fb99cc14ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:14.264580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ff1d-da0c-4a09-8d58-28fb99cc14ae service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:14.283312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1190/2381] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:18.456317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:18.509018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:18.520508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75df995-d273-4b43-92ce-e68f80267834 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:18.525424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:18.526037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:18.526312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:18.526580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] PATH_INFO: `/v3/users/e369418b0abe47e994ca83865ec699c3` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:18.527667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e369418b0abe47e994ca83865ec699c3)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:18.529611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:18.576796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e369418b0abe47e994ca83865ec699c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:18.586501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e369418b0abe47e994ca83865ec699c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:18.587387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e369418b0abe47e994ca83865ec699c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:18.605015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e369418b0abe47e994ca83865ec699c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:18.612748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e369418b0abe47e994ca83865ec699c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:18.620072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1192/2382] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:18 2022] DELETE /identity/v3/users/e369418b0abe47e994ca83865ec699c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:18.624663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:18.625478 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:18.625753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:18.646739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:18.648127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:18.714914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1191/2383] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:58:18.721728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:18.723156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:18.795461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9d3f-5b58-41b7-8dec-91c59e2f0b9a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:18.799603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:18.800320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:18.800684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:18.801013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:18.810801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:18.812360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:18.822987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1193/2384] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:19.124813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.126461 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:19.139618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73baebd-f668-44c0-ac8f-190450a7d75e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.146622 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.147557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.148045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.148402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] PATH_INFO: `/v3/projects/9878f45a8cca48cb80ea31c728d33d2b` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.150436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9878f45a8cca48cb80ea31c728d33d2b)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:19.152667 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:19.205296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9878f45a8cca48cb80ea31c728d33d2b', 'request_id': 'req-b8f3dfe0-4604-4c86-9a76-1df0633d2108'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.213905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9878f45a8cca48cb80ea31c728d33d2b', 'request_id': 'req-b8f3dfe0-4604-4c86-9a76-1df0633d2108'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.220610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9878f45a8cca48cb80ea31c728d33d2b', 'request_id': 'req-b8f3dfe0-4604-4c86-9a76-1df0633d2108'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.233283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] The token cache is being invalidate because project 9878f45a8cca48cb80ea31c728d33d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:19.233589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.234212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.236111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1192/2385] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:19 2022] DELETE /identity/v3/projects/9878f45a8cca48cb80ea31c728d33d2b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:19.240847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.250695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70458f-c956-4d2c-a80c-9c1e9d6352d4 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.311838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.312778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.313298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:19.313639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] PATH_INFO: `/v3/users/c61b763d2da54626a029bac9288dae83` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:19.315161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61b763d2da54626a029bac9288dae83)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:19.316949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:19.360586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:19.397518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61b763d2da54626a029bac9288dae83'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.406860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61b763d2da54626a029bac9288dae83'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.407523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61b763d2da54626a029bac9288dae83'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.421382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61b763d2da54626a029bac9288dae83'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.431139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61b763d2da54626a029bac9288dae83'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:19.437746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1194/2386] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:19 2022] DELETE /identity/v3/users/c61b763d2da54626a029bac9288dae83 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:19.906849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:19.908307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:19.923100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3dfe0-4604-4c86-9a76-1df0633d2108 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:19.963486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:19.998224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:19.999531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:19.999819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.000100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] PATH_INFO: `/v3/projects/0cdbcc110b57478da8b1d174347377bb` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.001310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdbcc110b57478da8b1d174347377bb)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.003207 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.053356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdbcc110b57478da8b1d174347377bb', 'request_id': 'req-1e09e536-659c-4fe9-aa4d-51bfa8082335'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.062488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdbcc110b57478da8b1d174347377bb', 'request_id': 'req-1e09e536-659c-4fe9-aa4d-51bfa8082335'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.072029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdbcc110b57478da8b1d174347377bb', 'request_id': 'req-1e09e536-659c-4fe9-aa4d-51bfa8082335'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.088283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] The token cache is being invalidate because project 0cdbcc110b57478da8b1d174347377bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:20.088283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.088742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.090439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1193/2387] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:19 2022] DELETE /identity/v3/projects/0cdbcc110b57478da8b1d174347377bb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:20.094174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.095668 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:20.108648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994834-56c9-4938-bc44-f487ead62af6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.169917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.170562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.170843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.171118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] PATH_INFO: `/v3/users/4e6ae6d282b84908942815486ffa06f0` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.172346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6ae6d282b84908942815486ffa06f0)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.174307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.226002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6ae6d282b84908942815486ffa06f0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.233492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6ae6d282b84908942815486ffa06f0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.234159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6ae6d282b84908942815486ffa06f0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.249302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6ae6d282b84908942815486ffa06f0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.256540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-db79d760-554e-47ee-8bb7-204b3c7d0a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6ae6d282b84908942815486ffa06f0'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.262570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1195/2388] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:20 2022] DELETE /identity/v3/users/4e6ae6d282b84908942815486ffa06f0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:20.543458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.545000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:20.558751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e536-659c-4fe9-aa4d-51bfa8082335 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.656110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.657871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.658359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.658837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] PATH_INFO: `/v3/projects/53e585fc86a841048200a66458c8a07a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.660371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e585fc86a841048200a66458c8a07a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.663171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.723764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e585fc86a841048200a66458c8a07a', 'request_id': 'req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.733202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e585fc86a841048200a66458c8a07a', 'request_id': 'req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.740424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.742597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e585fc86a841048200a66458c8a07a', 'request_id': 'req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.758614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] The token cache is being invalidate because project 53e585fc86a841048200a66458c8a07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:20.758907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.759568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-dca64e5e-f6e4-4816-b3cf-db041bf6c1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:20.761077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1194/2389] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:20 2022] DELETE /identity/v3/projects/53e585fc86a841048200a66458c8a07a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:20.765933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b7f6-ae36-46ea-9e23-5e429ada9d1d None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.766277 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b7f6-ae36-46ea-9e23-5e429ada9d1d None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.766555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b7f6-ae36-46ea-9e23-5e429ada9d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.787546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1305b7f6-ae36-46ea-9e23-5e429ada9d1d None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:20.788966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1305b7f6-ae36-46ea-9e23-5e429ada9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:20.798120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:20.859963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1196/2390] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:20.868500 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c7324-6352-4fed-82bd-5b6a20f63c4e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.868705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c7324-6352-4fed-82bd-5b6a20f63c4e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.868976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c7324-6352-4fed-82bd-5b6a20f63c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.889806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bc0c7324-6352-4fed-82bd-5b6a20f63c4e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:20.891016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bc0c7324-6352-4fed-82bd-5b6a20f63c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:20.899768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1195/2391] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:20.904202 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b7f6-ae36-46ea-9e23-5e429ada9d1d None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.914599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b7f6-ae36-46ea-9e23-5e429ada9d1d None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.919720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.920338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.920777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.921060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.921765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:20.922065 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.923684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.936821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1197/2392] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:58:20.941160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c7324-6352-4fed-82bd-5b6a20f63c4e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:20.951602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c7324-6352-4fed-82bd-5b6a20f63c4e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:20.956504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:20.957625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:20.957625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:20.957922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:20.959000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:20.961047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:20.990303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1196/2393] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:20 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:20.994754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.004680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414acca1-bfc2-4ef9-9cdd-8b8c21f71da1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.063606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.064228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.064485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.064753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.065410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.067304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.092625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1198/2394] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:20 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:21.094074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.104634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c7c1-c0ef-4727-a9d9-e94eb27e2fdc admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.109226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.109817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.110353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.110624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.111299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.112910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.123834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1197/2395] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:21.127752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.138869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907a287-a574-40ad-a7fb-124e78b2e375 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.143921 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0a87e-eff6-4537-ad54-f163355bc2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.144520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0a87e-eff6-4537-ad54-f163355bc2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.144796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0a87e-eff6-4537-ad54-f163355bc2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.145070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0a87e-eff6-4537-ad54-f163355bc2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.145750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0a87e-eff6-4537-ad54-f163355bc2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.147644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0a87e-eff6-4537-ad54-f163355bc2d2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.158264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1199/2396] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:21.162641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.172449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64049f2c-dfe4-4bf7-9c22-793c85f73018 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.177879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.178533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.178809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.179077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] PATH_INFO: `/v3/projects/64ac392961f2421089d6a3190651e6bb/users/24fc8f54ea914cf5bd4c11bffa272ed9/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.196392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ac392961f2421089d6a3190651e6bb, user_id=24fc8f54ea914cf5bd4c11bffa272ed9, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.199196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.213374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1198/2397] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:21 2022] PUT /identity/v3/projects/64ac392961f2421089d6a3190651e6bb/users/24fc8f54ea914cf5bd4c11bffa272ed9/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:21.225071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571f39f-b8da-4780-a9c3-ee10f7799cc7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.225374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571f39f-b8da-4780-a9c3-ee10f7799cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.225648 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571f39f-b8da-4780-a9c3-ee10f7799cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.253881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5571f39f-b8da-4780-a9c3-ee10f7799cc7 None None] MFA Rules not processed for user `24fc8f54ea914cf5bd4c11bffa272ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:21.255093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5571f39f-b8da-4780-a9c3-ee10f7799cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:21.324753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1200/2398] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:21.335606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:21.337288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:21.395688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba859092-98e2-4eff-ada2-482378d6f69b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:21.399954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:21.400557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:21.400830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:21.401098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:21.410628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:21.412751 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:21.422576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1199/2399] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:31.321563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:31.400172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9901a5-aa2d-4d23-bf73-d9fabea6548f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:31.400534 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9901a5-aa2d-4d23-bf73-d9fabea6548f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:31.400897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9901a5-aa2d-4d23-bf73-d9fabea6548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:31.418011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:31.422523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9f9901a5-aa2d-4d23-bf73-d9fabea6548f None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:31.423906 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9f9901a5-aa2d-4d23-bf73-d9fabea6548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:31.482696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1201/2400] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:31.525071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:31.526509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:31.595426 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630f3f-d957-4c7a-aac6-dd3254b08396 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:31.601133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9c40d-54b7-4311-a6f0-9c7b4430e28c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:31.601783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9c40d-54b7-4311-a6f0-9c7b4430e28c service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:31.602060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9c40d-54b7-4311-a6f0-9c7b4430e28c service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:31.602332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9c40d-54b7-4311-a6f0-9c7b4430e28c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:31.610652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9c40d-54b7-4311-a6f0-9c7b4430e28c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:31.612219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9c40d-54b7-4311-a6f0-9c7b4430e28c service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:31.620634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1200/2401] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:58:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:58:31.877110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9901a5-aa2d-4d23-bf73-d9fabea6548f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:31.945593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9901a5-aa2d-4d23-bf73-d9fabea6548f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:31.949983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:31.950614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:31.951290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:31.951567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] PATH_INFO: `/v3/users/24fc8f54ea914cf5bd4c11bffa272ed9` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:31.952793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fc8f54ea914cf5bd4c11bffa272ed9)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:31.954919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:32.013571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fc8f54ea914cf5bd4c11bffa272ed9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:32.029375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fc8f54ea914cf5bd4c11bffa272ed9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:32.030110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fc8f54ea914cf5bd4c11bffa272ed9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:32.045413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fc8f54ea914cf5bd4c11bffa272ed9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:32.055077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fc8f54ea914cf5bd4c11bffa272ed9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:32.062013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1202/2402] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:31 2022] DELETE /identity/v3/users/24fc8f54ea914cf5bd4c11bffa272ed9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:32.067091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ad34-3d5d-470b-a2d4-38f9ab8e90ee None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.067562 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ad34-3d5d-470b-a2d4-38f9ab8e90ee None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.068143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224ad34-3d5d-470b-a2d4-38f9ab8e90ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:32.101145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a224ad34-3d5d-470b-a2d4-38f9ab8e90ee None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:32.102376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a224ad34-3d5d-470b-a2d4-38f9ab8e90ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:32.174064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1201/2403] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:32.184439 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:32.185963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:32.204662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573d81a-10b1-4d5b-9aca-47be5809322b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.205039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573d81a-10b1-4d5b-9aca-47be5809322b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.205341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573d81a-10b1-4d5b-9aca-47be5809322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:32.222786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:32.226985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9573d81a-10b1-4d5b-9aca-47be5809322b None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:32.228286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9573d81a-10b1-4d5b-9aca-47be5809322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:32.258636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1643-022f-4832-8f81-41b5f6627208 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:32.262272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:32.262929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.263207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.263474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:32.274069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:32.275502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:32.286224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1203/2404] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:32.290967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1202/2405] 10.222.0.42 () {58 vars in 967 bytes} [Mon Sep 19 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:58:32.305716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:32.307287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:32.407222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03157009-c754-4355-b6f2-ac99673e7b37 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:32.413954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:32.414618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.414899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.415176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:32.428266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:32.430126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:32.441519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1204/2406] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:58:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:58:32.725888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.726434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.726577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:32.749238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:32.751257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:32.759079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1203/2407] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:32.772345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:32.784191 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54066176-44b3-47c0-82b7-5ab4af955e5f service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:32.791238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabf12b-eece-41a7-9e05-33d830ea1696 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:32.791954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf12b-eece-41a7-9e05-33d830ea1696 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:32.792218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf12b-eece-41a7-9e05-33d830ea1696 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:32.792525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf12b-eece-41a7-9e05-33d830ea1696 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:32.801717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabf12b-eece-41a7-9e05-33d830ea1696 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:32.803845 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabf12b-eece-41a7-9e05-33d830ea1696 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:32.814946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1205/2408] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:58:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:58:33.245859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.247494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:33.268228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fc07-42a1-4075-aaf5-89ae01eecf44 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.276116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.276945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.278094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.278575 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] PATH_INFO: `/v3/projects/64ac392961f2421089d6a3190651e6bb` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.280332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ac392961f2421089d6a3190651e6bb)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:33.282702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:33.317206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447089c-44e1-491b-99a8-6a52ed5ac849 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.317477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447089c-44e1-491b-99a8-6a52ed5ac849 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.318504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447089c-44e1-491b-99a8-6a52ed5ac849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.338211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:33.345492 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5447089c-44e1-491b-99a8-6a52ed5ac849 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:33.346556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5447089c-44e1-491b-99a8-6a52ed5ac849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:33.358360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1206/2409] 10.222.0.42 () {58 vars in 967 bytes} [Mon Sep 19 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:33.375312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447089c-44e1-491b-99a8-6a52ed5ac849 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.375652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ac392961f2421089d6a3190651e6bb', 'request_id': 'req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:33.384892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ac392961f2421089d6a3190651e6bb', 'request_id': 'req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:33.391232 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ac392961f2421089d6a3190651e6bb', 'request_id': 'req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:33.394240 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447089c-44e1-491b-99a8-6a52ed5ac849 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.407178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] The token cache is being invalidate because project 64ac392961f2421089d6a3190651e6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:33.407809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:33.408519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e642ff3a-dbbd-42a5-b23d-252e28e8aec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:33.413632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1204/2410] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:33 2022] DELETE /identity/v3/projects/64ac392961f2421089d6a3190651e6bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:33.416172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6244-b437-4dbc-8b65-c9bb8d00badb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.416457 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6244-b437-4dbc-8b65-c9bb8d00badb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.416736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6244-b437-4dbc-8b65-c9bb8d00badb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.443734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-235c6244-b437-4dbc-8b65-c9bb8d00badb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:33.445716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-235c6244-b437-4dbc-8b65-c9bb8d00badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:33.463630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.464298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.464591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.464867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.466722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:33.516128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:33.525957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1205/2411] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:58:33.527569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d64bca-aecb-4fc3-88cf-814dccad95a1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.527855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d64bca-aecb-4fc3-88cf-814dccad95a1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.528677 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d64bca-aecb-4fc3-88cf-814dccad95a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.534280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:33.535866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:33.545893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1207/2412] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:58:33.550684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a7d64bca-aecb-4fc3-88cf-814dccad95a1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:33.551896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a7d64bca-aecb-4fc3-88cf-814dccad95a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:33.563692 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1206/2413] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:33.568652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.581844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fba54-c98d-4ac3-af34-9da76d0524aa service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.588451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.589100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.589393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.589657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.590319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:33.590626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:33.592228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:33.606666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1208/2414] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:33.610933 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d64bca-aecb-4fc3-88cf-814dccad95a1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.621957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d64bca-aecb-4fc3-88cf-814dccad95a1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.628693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.629336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.629617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.629887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.630561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:33.632450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:33.684809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1207/2415] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:33 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:33.689294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.715257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c770ac-d824-4829-84f5-d55cb8ddb968 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.884106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.884727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.885002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.885330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.886015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:33.887937 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:33.917555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1209/2416] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:33 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:33.922191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.937087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4b74-c873-4dce-aacd-10c864c25fcb admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.955267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.957250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.957603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.957970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.958926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:33.960434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:33.977208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1208/2417] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:33.978832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:33.991736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627cb4f-e3f3-4da9-8836-bda65abc259d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:33.996729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334cc96-2ad3-42b4-990a-25720d9ed8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:33.997653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334cc96-2ad3-42b4-990a-25720d9ed8ff admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:33.997653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334cc96-2ad3-42b4-990a-25720d9ed8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:33.998156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334cc96-2ad3-42b4-990a-25720d9ed8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:33.998598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334cc96-2ad3-42b4-990a-25720d9ed8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:34.000446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334cc96-2ad3-42b4-990a-25720d9ed8ff admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:34.013011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1210/2418] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:34.017475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.028863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cbb0a-2269-4cf4-8394-4cbbe05ae18e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.034121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.034805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.035078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.035566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] PATH_INFO: `/v3/projects/5d411b8c0fd345f2a794734f36a0c8a1/users/99fa064b8e8a4750bfd0faf40ffec2f1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.056621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d411b8c0fd345f2a794734f36a0c8a1, user_id=99fa064b8e8a4750bfd0faf40ffec2f1, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:34.060073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:34.085383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1209/2419] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:34 2022] PUT /identity/v3/projects/5d411b8c0fd345f2a794734f36a0c8a1/users/99fa064b8e8a4750bfd0faf40ffec2f1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:34.152784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.153070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.153374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.198843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] MFA Rules not processed for user `99fa064b8e8a4750bfd0faf40ffec2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:34.200144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:34.296504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1211/2420] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:34.307857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:34.309589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:34.377504 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:34.390452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b90863-16c7-44a6-b865-a61ba9c28ed3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:34.395429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d6a8-3cfa-4d3c-b367-90ae89c4c7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:34.396700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d6a8-3cfa-4d3c-b367-90ae89c4c7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:34.397051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d6a8-3cfa-4d3c-b367-90ae89c4c7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:34.397414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d6a8-3cfa-4d3c-b367-90ae89c4c7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:34.409481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d6a8-3cfa-4d3c-b367-90ae89c4c7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:34.410946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d6a8-3cfa-4d3c-b367-90ae89c4c7f4 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:34.423314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1210/2421] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:36.008398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.009834 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.049546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.094243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c2d94-8937-4e76-b643-cbf6272738d4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.099009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.099839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.100125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.100400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] PATH_INFO: `/v3/users/8a9ee9734d0941e5b36b069a652f188b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.101572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9ee9734d0941e5b36b069a652f188b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.103485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.149940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9ee9734d0941e5b36b069a652f188b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.157018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9ee9734d0941e5b36b069a652f188b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.157688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9ee9734d0941e5b36b069a652f188b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.169563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9ee9734d0941e5b36b069a652f188b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.176630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9ee9734d0941e5b36b069a652f188b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.183055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1212/2422] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:36 2022] DELETE /identity/v3/users/8a9ee9734d0941e5b36b069a652f188b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:36.187665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.188153 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.188244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.207505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:36.208832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.269285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1211/2423] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:36.279443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.280852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.337757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac6e2-23be-47fd-86e6-1526d7f7a83c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.341394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7024784-bd2b-441a-91a3-938a39491e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.341992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024784-bd2b-441a-91a3-938a39491e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.342266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024784-bd2b-441a-91a3-938a39491e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.342536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7024784-bd2b-441a-91a3-938a39491e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.351549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024784-bd2b-441a-91a3-938a39491e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.352965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7024784-bd2b-441a-91a3-938a39491e26 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.362618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1213/2424] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:36.532827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.534458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.548690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3424b82-1766-4ffa-ad36-b0bcc2f617f7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.554338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.555140 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.555597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.556050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] PATH_INFO: `/v3/projects/d1b3f54bd77d4c6c8ced03f9c78232c7` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.557991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b3f54bd77d4c6c8ced03f9c78232c7)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.559120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.614272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b3f54bd77d4c6c8ced03f9c78232c7', 'request_id': 'req-25e23833-639f-4524-af45-dfb54652a03d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.623623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b3f54bd77d4c6c8ced03f9c78232c7', 'request_id': 'req-25e23833-639f-4524-af45-dfb54652a03d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.629484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b3f54bd77d4c6c8ced03f9c78232c7', 'request_id': 'req-25e23833-639f-4524-af45-dfb54652a03d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.640685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] The token cache is being invalidate because project d1b3f54bd77d4c6c8ced03f9c78232c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:36.640967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.641617 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-25e23833-639f-4524-af45-dfb54652a03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:36.643088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1212/2425] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:36 2022] DELETE /identity/v3/projects/d1b3f54bd77d4c6c8ced03f9c78232c7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:36.648546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5424-060e-4155-8771-094f917728da None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.648919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5424-060e-4155-8771-094f917728da None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.649281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5424-060e-4155-8771-094f917728da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.670183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-892f5424-060e-4155-8771-094f917728da None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:36.671379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-892f5424-060e-4155-8771-094f917728da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.718731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.731747 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1214/2426] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:36.740123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e315-d016-48a0-9b4d-3b1590e7b898 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.740627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e315-d016-48a0-9b4d-3b1590e7b898 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.740964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e315-d016-48a0-9b4d-3b1590e7b898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.760881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-eac9e315-d016-48a0-9b4d-3b1590e7b898 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:36.762116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-eac9e315-d016-48a0-9b4d-3b1590e7b898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.770120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1213/2427] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:36.774365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5424-060e-4155-8771-094f917728da None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.785693 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5424-060e-4155-8771-094f917728da None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.789483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a366-ac03-483d-baa6-9fea15279ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.790081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a366-ac03-483d-baa6-9fea15279ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.790355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a366-ac03-483d-baa6-9fea15279ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.790621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a366-ac03-483d-baa6-9fea15279ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.791267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a366-ac03-483d-baa6-9fea15279ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:36.791597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a366-ac03-483d-baa6-9fea15279ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.793297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a366-ac03-483d-baa6-9fea15279ac2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.807630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1215/2428] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:36.812233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9e315-d016-48a0-9b4d-3b1590e7b898 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.823109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9e315-d016-48a0-9b4d-3b1590e7b898 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.827765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.828351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.828625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.828890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.829559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.831424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.869990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.870274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.870547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.874551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1214/2429] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:36 2022] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:36.875513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.890873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:36.892077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.928859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:36.945723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250226b4-4292-4839-9b5d-691c4e414fd5 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.950383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.950988 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.951268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.951549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:36.951756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1216/2430] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:58:36.952242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:36.954199 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:36.964994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.967476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:36.982038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1215/2431] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:36 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:58:36.983119 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:36.993019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106f851-3f7b-4831-a784-27e4a1388275 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:36.997755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:36.998685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:36.999146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:36.999602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.000536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.002470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.015568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1216/2432] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:37.016783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.027093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969056d-25af-4054-8247-dc5d13c94c43 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.031668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.032245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.032519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.032789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.033459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.034999 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.039355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8e4a-09fd-4375-80a8-d33b18a230c6 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.045226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d08c2-4ae2-4762-8bff-fba268e97c51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.045826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d08c2-4ae2-4762-8bff-fba268e97c51 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.046097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d08c2-4ae2-4762-8bff-fba268e97c51 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.046353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d08c2-4ae2-4762-8bff-fba268e97c51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.046944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1217/2433] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:58:37.051024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.055900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d08c2-4ae2-4762-8bff-fba268e97c51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.057699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d08c2-4ae2-4762-8bff-fba268e97c51 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.064862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c24-5ba7-4699-a4d5-3a88f120a92f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.066323 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.066979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.067204 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1217/2434] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:58:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:58:37.067464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.067619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] PATH_INFO: `/v3/projects/d635c5108e0c45af864da6d97be6b65b/users/d0ea27170f5f48318f349d15939e6714/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.084584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d635c5108e0c45af864da6d97be6b65b, user_id=d0ea27170f5f48318f349d15939e6714, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.087340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.117184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1218/2435] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:37 2022] PUT /identity/v3/projects/d635c5108e0c45af864da6d97be6b65b/users/d0ea27170f5f48318f349d15939e6714/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:58:37.176629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78ff56-e7a9-4af2-a07e-462f138441f3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.177005 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78ff56-e7a9-4af2-a07e-462f138441f3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.177943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78ff56-e7a9-4af2-a07e-462f138441f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.221981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9e78ff56-e7a9-4af2-a07e-462f138441f3 None None] MFA Rules not processed for user `d0ea27170f5f48318f349d15939e6714`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:37.224803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9e78ff56-e7a9-4af2-a07e-462f138441f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:37.318944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1218/2436] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:37.328691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:37.332486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:37.435670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36788a61-0cd4-4b1b-aee7-a8446436aa3c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:37.440308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315259e9-9ba3-479a-ab56-27c7e98672db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:37.440936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315259e9-9ba3-479a-ab56-27c7e98672db service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:37.441247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315259e9-9ba3-479a-ab56-27c7e98672db service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:37.441517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315259e9-9ba3-479a-ab56-27c7e98672db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:37.451040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315259e9-9ba3-479a-ab56-27c7e98672db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:37.452384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315259e9-9ba3-479a-ab56-27c7e98672db service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:37.462010 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1219/2437] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:42.884141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78ff56-e7a9-4af2-a07e-462f138441f3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:42.895523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=100 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:42.971756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78ff56-e7a9-4af2-a07e-462f138441f3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:42.978616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:42.979343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:42.979661 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:42.979994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] PATH_INFO: `/v3/users/d0ea27170f5f48318f349d15939e6714` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:42.981679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ea27170f5f48318f349d15939e6714)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:42.984050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:43.047830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ea27170f5f48318f349d15939e6714'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.056744 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ea27170f5f48318f349d15939e6714'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.057852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ea27170f5f48318f349d15939e6714'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.072199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ea27170f5f48318f349d15939e6714'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.080156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ea27170f5f48318f349d15939e6714'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.089397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1219/2438] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:42 2022] DELETE /identity/v3/users/d0ea27170f5f48318f349d15939e6714 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:43.094160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.094723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.094723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.117174 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:43.118868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:43.196023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1220/2439] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:43.206548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:43.208105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:43.275660 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfcba5-a4b7-425e-a56d-95199adc70ee admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:43.279458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3a724-fb09-4d12-8958-8e8d864fd170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:43.280088 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3a724-fb09-4d12-8958-8e8d864fd170 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.280364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3a724-fb09-4d12-8958-8e8d864fd170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.280629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3a724-fb09-4d12-8958-8e8d864fd170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.290910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3a724-fb09-4d12-8958-8e8d864fd170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:43.292518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3a724-fb09-4d12-8958-8e8d864fd170 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:43.303373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1220/2440] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:43.623898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:43.627491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:43.679599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f145a9-7919-4c57-8cc7-38f8ab2c8a1b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:43.685104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:43.685775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.686549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.686833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] PATH_INFO: `/v3/projects/d635c5108e0c45af864da6d97be6b65b` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.687972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d635c5108e0c45af864da6d97be6b65b)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:43.689922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:43.738272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:43.764961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd635c5108e0c45af864da6d97be6b65b', 'request_id': 'req-36b2e4a1-abde-41c3-af9c-46f9288235e5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.775123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd635c5108e0c45af864da6d97be6b65b', 'request_id': 'req-36b2e4a1-abde-41c3-af9c-46f9288235e5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.784134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd635c5108e0c45af864da6d97be6b65b', 'request_id': 'req-36b2e4a1-abde-41c3-af9c-46f9288235e5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.798881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] The token cache is being invalidate because project d635c5108e0c45af864da6d97be6b65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:43.799297 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.799912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-36b2e4a1-abde-41c3-af9c-46f9288235e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:43.801636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1221/2441] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:43 2022] DELETE /identity/v3/projects/d635c5108e0c45af864da6d97be6b65b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:43.806580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2065b-f232-41f0-aec0-e63bafc885b9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.807092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2065b-f232-41f0-aec0-e63bafc885b9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.807515 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2065b-f232-41f0-aec0-e63bafc885b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:43.837772 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7cd2065b-f232-41f0-aec0-e63bafc885b9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:43.858900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7cd2065b-f232-41f0-aec0-e63bafc885b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:43.889044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:43.981611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1221/2442] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:58:43.990882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9a2e-7d91-4769-948d-3c3a09d5ca87 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:43.991158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9a2e-7d91-4769-948d-3c3a09d5ca87 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:43.991438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9a2e-7d91-4769-948d-3c3a09d5ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.023200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c28a9a2e-7d91-4769-948d-3c3a09d5ca87 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:44.023200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c28a9a2e-7d91-4769-948d-3c3a09d5ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:44.042722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1222/2443] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:44.047572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2065b-f232-41f0-aec0-e63bafc885b9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.068452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2065b-f232-41f0-aec0-e63bafc885b9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.076410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.077046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.077434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.077707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.081537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:58:44.081940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.083904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.097335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1222/2444] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:58:44.102389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a9a2e-7d91-4769-948d-3c3a09d5ca87 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.112254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a9a2e-7d91-4769-948d-3c3a09d5ca87 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.117709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.118378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.118722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.119059 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.119767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.121861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.163671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1223/2445] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:44 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:44.165000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.178965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df5399-ca3d-4e74-8b0f-cfa49416075a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.252870 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.253436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.253716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.253951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.254577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.256879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.284396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1223/2446] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:44 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:44.289357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.299975 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d352-ea41-4fbc-8b84-d6ef62d5e0ce admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.305932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.306550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.306897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.307097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.307739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.309381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.321213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1224/2447] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:44.325514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.338128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3da79-96e1-47ec-b515-12948e44f6b5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.342862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eafffb-5dfc-4caa-af9b-db91af66609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.343462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eafffb-5dfc-4caa-af9b-db91af66609a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.352529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eafffb-5dfc-4caa-af9b-db91af66609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.352858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eafffb-5dfc-4caa-af9b-db91af66609a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.353585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eafffb-5dfc-4caa-af9b-db91af66609a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.355670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eafffb-5dfc-4caa-af9b-db91af66609a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.371105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1224/2448] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:44.374932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.394886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1195290-1059-4ed3-be2c-bf51e43fa2d8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.406023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.407292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.407744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.408225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] PATH_INFO: `/v3/projects/d5857b6e68c6418dbaaccd7d206c1760/users/3c3e932c283749d097943169ae7bc966/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.435080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5857b6e68c6418dbaaccd7d206c1760, user_id=3c3e932c283749d097943169ae7bc966, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.438548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.460544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1225/2449] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:44 2022] PUT /identity/v3/projects/d5857b6e68c6418dbaaccd7d206c1760/users/3c3e932c283749d097943169ae7bc966/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:44.466486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.466897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.467305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.492741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:44.493996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:44.573017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1225/2450] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:44.583969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:44.586045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:44.675495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de44d-c77f-4250-acff-70adb720e389 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:44.684820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d178c3-6d93-4794-9453-e4d5bcd218fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:44.684820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d178c3-6d93-4794-9453-e4d5bcd218fe service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:44.684820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d178c3-6d93-4794-9453-e4d5bcd218fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:44.684820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d178c3-6d93-4794-9453-e4d5bcd218fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:44.695898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d178c3-6d93-4794-9453-e4d5bcd218fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:44.698958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d178c3-6d93-4794-9453-e4d5bcd218fe service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:44.713380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1226/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:45.143667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.145372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:45.168364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156561cd-c00e-48a1-98b8-fa333f8c0bdf None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:45.184771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:45.185549 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.185865 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.186165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] PATH_INFO: `/v3/users/99fa064b8e8a4750bfd0faf40ffec2f1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.187419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99fa064b8e8a4750bfd0faf40ffec2f1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:45.189952 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:45.259364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:45.280585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99fa064b8e8a4750bfd0faf40ffec2f1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:45.291079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99fa064b8e8a4750bfd0faf40ffec2f1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:45.291795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99fa064b8e8a4750bfd0faf40ffec2f1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:45.307006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99fa064b8e8a4750bfd0faf40ffec2f1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:45.315639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99fa064b8e8a4750bfd0faf40ffec2f1'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:45.322728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1226/2452] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:58:45 2022] DELETE /identity/v3/users/99fa064b8e8a4750bfd0faf40ffec2f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:45.327238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.327867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.327867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.359412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:45.362665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:45.459750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:45.481610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1227/2453] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:45.492827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:45.494390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:45.638837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf390a98-73a4-4e4f-834a-f405a7c4bba6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:45.644055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e182c8-2186-4aee-9e4d-2d44cca1930a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:45.644567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e182c8-2186-4aee-9e4d-2d44cca1930a service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:45.644843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e182c8-2186-4aee-9e4d-2d44cca1930a service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:45.645210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e182c8-2186-4aee-9e4d-2d44cca1930a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:45.671984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e182c8-2186-4aee-9e4d-2d44cca1930a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:45.681373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e182c8-2186-4aee-9e4d-2d44cca1930a service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:45.707587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1227/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:58:46.468409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:46.470621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:46.497364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfdb80-4739-4634-9e1b-2659d780d94c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:46.512446 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:46.512899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:46.513195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:46.513468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] PATH_INFO: `/v3/projects/5d411b8c0fd345f2a794734f36a0c8a1` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:46.514635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d411b8c0fd345f2a794734f36a0c8a1)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:46.522215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:46.607391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d411b8c0fd345f2a794734f36a0c8a1', 'request_id': 'req-866df245-03f9-40e1-bc29-1de4c7992188'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:46.622532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d411b8c0fd345f2a794734f36a0c8a1', 'request_id': 'req-866df245-03f9-40e1-bc29-1de4c7992188'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:46.632274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d411b8c0fd345f2a794734f36a0c8a1', 'request_id': 'req-866df245-03f9-40e1-bc29-1de4c7992188'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:46.653143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] The token cache is being invalidate because project 5d411b8c0fd345f2a794734f36a0c8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:58:46.653613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:46.654417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:58:46.659951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1228/2455] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:58:46 2022] DELETE /identity/v3/projects/5d411b8c0fd345f2a794734f36a0c8a1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:50.948739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1671e-e357-476c-be7e-2847612bc119 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:50.949288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1671e-e357-476c-be7e-2847612bc119 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:50.951894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1671e-e357-476c-be7e-2847612bc119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.001678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-edb1671e-e357-476c-be7e-2847612bc119 None None] MFA Rules not processed for user `3c3e932c283749d097943169ae7bc966`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:51.003452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-edb1671e-e357-476c-be7e-2847612bc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:51.167142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1228/2456] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:58:51.172941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.175229 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:51.299542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df245-03f9-40e1-bc29-1de4c7992188 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.306737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.307586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.307938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.308216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.308868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.310853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.371094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1229/2457] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 11:58:51 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:51.378264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1671e-e357-476c-be7e-2847612bc119 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.397997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1671e-e357-476c-be7e-2847612bc119 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.469547 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:51.519718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.520422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.520702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.521636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.522322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.524822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.578886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1229/2458] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 11:58:51 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:58:51.583453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.595435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4cff-84e8-4022-bea7-a632d826f6f6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.600847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.601854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.602201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.602572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.603271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.604936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.623352 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1230/2459] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:51.624618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.661698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74260e7-52fd-4b97-8519-d966638ff3c5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.670371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.671710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.671999 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.672280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] PATH_INFO: `/v3/projects/f535b7a17f7e478ea4464b37e219a0f4/users/42a9301bff7d48a7b3eef05242f185a2/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.699379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f535b7a17f7e478ea4464b37e219a0f4, user_id=42a9301bff7d48a7b3eef05242f185a2, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.702592 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.741184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1230/2460] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:51 2022] PUT /identity/v3/projects/f535b7a17f7e478ea4464b37e219a0f4/users/42a9301bff7d48a7b3eef05242f185a2/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:51.743130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.760376 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5b1b-4447-4907-8530-54fe4a8c2203 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.841971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:51.855678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04691107-9bac-48d7-bf37-2b868185df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.856543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04691107-9bac-48d7-bf37-2b868185df64 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.857035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04691107-9bac-48d7-bf37-2b868185df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.857488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04691107-9bac-48d7-bf37-2b868185df64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.858309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04691107-9bac-48d7-bf37-2b868185df64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.860063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04691107-9bac-48d7-bf37-2b868185df64 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:51.876053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1231/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:58:51.880882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:58:51.930427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0b656-349a-4e07-b34e-d90232e7a8ac admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:58:51.952374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772f61a-4975-405c-a196-782995bad3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:58:51.954753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f61a-4975-405c-a196-782995bad3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:51.955362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f61a-4975-405c-a196-782995bad3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:51.956654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f61a-4975-405c-a196-782995bad3ae admin admin] PATH_INFO: `/v3/projects/f535b7a17f7e478ea4464b37e219a0f4/users/42a9301bff7d48a7b3eef05242f185a2/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:51.960981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772f61a-4975-405c-a196-782995bad3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f535b7a17f7e478ea4464b37e219a0f4, user_id=42a9301bff7d48a7b3eef05242f185a2, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:58:51.968970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772f61a-4975-405c-a196-782995bad3ae admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:58:52.008713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1231/2462] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 11:58:51 2022] PUT /identity/v3/projects/f535b7a17f7e478ea4464b37e219a0f4/users/42a9301bff7d48a7b3eef05242f185a2/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:58:53.911481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:58:53.912405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:58:53.912896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:58:53.980208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] MFA Rules not processed for user `5c395665e2ae44c4931ae90d2ab631ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:58:53.990860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:58:54.085428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1232/2463] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:01.377015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991990c9-cb27-4b69-8618-806ec3fdde4a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.377603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991990c9-cb27-4b69-8618-806ec3fdde4a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.377603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991990c9-cb27-4b69-8618-806ec3fdde4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.415347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-991990c9-cb27-4b69-8618-806ec3fdde4a None None] MFA Rules not processed for user `42a9301bff7d48a7b3eef05242f185a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:01.417665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-991990c9-cb27-4b69-8618-806ec3fdde4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:01.523491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1232/2464] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:01.539172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:01.540732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:01.608277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4310f-081b-4798-88e3-33739e86df5d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:01.612043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbbf68-a11b-4014-be77-4797e3400a80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:01.612641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbf68-a11b-4014-be77-4797e3400a80 service glance] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.612916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbf68-a11b-4014-be77-4797e3400a80 service glance] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.613212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbf68-a11b-4014-be77-4797e3400a80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.673953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbbf68-a11b-4014-be77-4797e3400a80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:01.675388 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbbf68-a11b-4014-be77-4797e3400a80 service glance] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:01.684989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1233/2465] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:59:01.821911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.822242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.822588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.846851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:01.848243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:01.860519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:01.861163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:01.861537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:01.886082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:01.887794 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:01.917504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1233/2466] 10.222.0.42 () {58 vars in 967 bytes} [Mon Sep 19 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:01.936094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:01.943170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:01.952085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:01.968729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1234/2467] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:01.979443 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:01.987235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:01.989475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:02.064946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1a7ac-35c5-4d08-ba8c-6331236fe6ee None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.071004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.071618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.071898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.072168 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.081735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:02.082640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:02.091903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22647d9d-7706-4817-a63b-b5cfeb603440 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:02.093711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1234/2468] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:59:02.099402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:02.100071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:02.100415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:02.100761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:02.126725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:02.128755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:02.146613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1235/2469] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:59:04.757538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:04.759721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:04.871156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3154d-dfc4-46e9-8a51-c267597199ad service swift] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:04.876154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:04.876886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:04.877283 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:04.877628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] PATH_INFO: `/v3/users/50eea739d1064348a2adcd4c5ba0b180` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:04.882163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50eea739d1064348a2adcd4c5ba0b180)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:04.884255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.065649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50eea739d1064348a2adcd4c5ba0b180'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.082797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50eea739d1064348a2adcd4c5ba0b180'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.084679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50eea739d1064348a2adcd4c5ba0b180'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.105406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50eea739d1064348a2adcd4c5ba0b180'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.117254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-35667537-797e-4309-9763-5fa8e7ff246c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50eea739d1064348a2adcd4c5ba0b180'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.126566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1235/2470] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 11:59:04 2022] DELETE /identity/v3/users/50eea739d1064348a2adcd4c5ba0b180 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:05.448916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:05.466637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d349b-6258-4178-975e-995d3572a221 service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:05.558870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:05.559647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:05.560030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:05.560783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] PATH_INFO: `/v3/projects/817d2b8950be4c9981b7db569fc7f04e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:05.563509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817d2b8950be4c9981b7db569fc7f04e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:05.565749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:05.669103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817d2b8950be4c9981b7db569fc7f04e', 'request_id': 'req-0addbff2-d391-40c5-9900-0bb06814cf92'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.679294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817d2b8950be4c9981b7db569fc7f04e', 'request_id': 'req-0addbff2-d391-40c5-9900-0bb06814cf92'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.693507 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817d2b8950be4c9981b7db569fc7f04e', 'request_id': 'req-0addbff2-d391-40c5-9900-0bb06814cf92'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.709065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] The token cache is being invalidate because project 817d2b8950be4c9981b7db569fc7f04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:59:05.711716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.712492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:59:05.717816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1236/2471] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 11:59:05 2022] DELETE /identity/v3/projects/817d2b8950be4c9981b7db569fc7f04e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:59:12.094638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825deab2-a5de-44fc-9d6a-54d46a3ad01c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:12.095216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825deab2-a5de-44fc-9d6a-54d46a3ad01c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:12.095216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825deab2-a5de-44fc-9d6a-54d46a3ad01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:12.139369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-825deab2-a5de-44fc-9d6a-54d46a3ad01c None None] MFA Rules not processed for user `3c3e932c283749d097943169ae7bc966`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:12.140879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-825deab2-a5de-44fc-9d6a-54d46a3ad01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:12.175295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:12.211916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1236/2472] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:13.949940 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:13.951750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:13.967784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:14.042361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addbff2-d391-40c5-9900-0bb06814cf92 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:14.049205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:14.049830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:14.050108 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:14.050378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:14.053195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:14.066048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:14.068211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:14.080866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1237/2473] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:59:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:59:15.595922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb820-9930-4358-9bcb-2a12b0dc9dc5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.596449 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb820-9930-4358-9bcb-2a12b0dc9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.596730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb820-9930-4358-9bcb-2a12b0dc9dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.619358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1a4fb820-9930-4358-9bcb-2a12b0dc9dc5 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:15.621479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1a4fb820-9930-4358-9bcb-2a12b0dc9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:15.707419 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1237/2474] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:15.723665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:15.725928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:15.809968 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5bdbc-ed8f-4f5b-aff0-8b4325fba814 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:15.817980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:15.818859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:15.819140 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:15.819414 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:15.828569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:15.830449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:15.840066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1238/2475] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:59:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:59:25.700684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=36 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:25.836377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=58 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:33.467857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aabee-134a-4dfc-a794-62b8652df0cb None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.468385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aabee-134a-4dfc-a794-62b8652df0cb None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.468385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aabee-134a-4dfc-a794-62b8652df0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.489718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-e92aabee-134a-4dfc-a794-62b8652df0cb None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:33.490923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e92aabee-134a-4dfc-a794-62b8652df0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:33.498398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1238/2476] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:59:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:33.520436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:33.532089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17a15-939f-420c-8513-a15ba235277c service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:33.537783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178cbd8-6651-4861-b571-eff773c35758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:33.538407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178cbd8-6651-4861-b571-eff773c35758 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:33.538688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178cbd8-6651-4861-b571-eff773c35758 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:33.538965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178cbd8-6651-4861-b571-eff773c35758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:33.547043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178cbd8-6651-4861-b571-eff773c35758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:33.548599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178cbd8-6651-4861-b571-eff773c35758 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:33.557099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1239/2477] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:59:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:59:43.483281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:43.553966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:47.900019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95e1e-3cc1-4ce8-8c1b-bf87d78f97ac None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.900583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95e1e-3cc1-4ce8-8c1b-bf87d78f97ac None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.900583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad95e1e-3cc1-4ce8-8c1b-bf87d78f97ac None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.901925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1239/2478] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:47.907792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6acca-7d19-461c-8702-6502e43f3ca5 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:47.908271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6acca-7d19-461c-8702-6502e43f3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:47.908393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6acca-7d19-461c-8702-6502e43f3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:47.930699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ecd6acca-7d19-461c-8702-6502e43f3ca5 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:47.931925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ecd6acca-7d19-461c-8702-6502e43f3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:48.002149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1240/2479] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:59:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:48.018358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad95e1e-3cc1-4ce8-8c1b-bf87d78f97ac None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.021073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4ad95e1e-3cc1-4ce8-8c1b-bf87d78f97ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:48.080941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad95e1e-3cc1-4ce8-8c1b-bf87d78f97ac None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.084846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd19d5f-feed-4c95-bab1-45f20ab5bdfc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.085483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19d5f-feed-4c95-bab1-45f20ab5bdfc service glance] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.085759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19d5f-feed-4c95-bab1-45f20ab5bdfc service glance] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.086052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19d5f-feed-4c95-bab1-45f20ab5bdfc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.096012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd19d5f-feed-4c95-bab1-45f20ab5bdfc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.097450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd19d5f-feed-4c95-bab1-45f20ab5bdfc service glance] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.108311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1240/2480] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:59:48.190786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2893-345a-4540-880d-37c6a9bf5f0b None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.191020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2893-345a-4540-880d-37c6a9bf5f0b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.191243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2893-345a-4540-880d-37c6a9bf5f0b None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.193211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1241/2481] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:48.198142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2edfb-4040-4ef1-926e-266aa6462d8c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.198503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2edfb-4040-4ef1-926e-266aa6462d8c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.198878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2edfb-4040-4ef1-926e-266aa6462d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.220026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4fe2edfb-4040-4ef1-926e-266aa6462d8c None None] MFA Rules not processed for user `d84265ba2619438485db9a18f94c87aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:48.221270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4fe2edfb-4040-4ef1-926e-266aa6462d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:48.272138 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1241/2482] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:59:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:48.284187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba2893-345a-4540-880d-37c6a9bf5f0b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.286345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-48ba2893-345a-4540-880d-37c6a9bf5f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:48.299321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba2893-345a-4540-880d-37c6a9bf5f0b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.303719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10ab7b-c284-4a63-89f3-52f9f9f105fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.304298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ab7b-c284-4a63-89f3-52f9f9f105fc service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.304573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ab7b-c284-4a63-89f3-52f9f9f105fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.304838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10ab7b-c284-4a63-89f3-52f9f9f105fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.313532 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10ab7b-c284-4a63-89f3-52f9f9f105fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.314998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10ab7b-c284-4a63-89f3-52f9f9f105fc service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.323941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1242/2483] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:59:48.408108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40cd6-2d22-4e12-becc-4648c017c91a None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.408394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40cd6-2d22-4e12-becc-4648c017c91a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.408670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40cd6-2d22-4e12-becc-4648c017c91a None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.410062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1242/2484] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:59:48.418897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3857-296a-415e-961b-6888975c19cc None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.419257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3857-296a-415e-961b-6888975c19cc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.419606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3857-296a-415e-961b-6888975c19cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.443925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fdfa3857-296a-415e-961b-6888975c19cc None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:48.445239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fdfa3857-296a-415e-961b-6888975c19cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:48.455473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1243/2485] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 11:59:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:48.467266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40cd6-2d22-4e12-becc-4648c017c91a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:48.478875 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40cd6-2d22-4e12-becc-4648c017c91a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:48.482569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd73c2-838a-43a2-8813-b2b59a53d652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:48.483094 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd73c2-838a-43a2-8813-b2b59a53d652 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:48.483370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd73c2-838a-43a2-8813-b2b59a53d652 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:48.483643 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd73c2-838a-43a2-8813-b2b59a53d652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:48.494665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd73c2-838a-43a2-8813-b2b59a53d652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:48.496089 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd73c2-838a-43a2-8813-b2b59a53d652 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:48.507914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1243/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:59:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:59:49.551267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa3857-296a-415e-961b-6888975c19cc None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:49.560624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa3857-296a-415e-961b-6888975c19cc None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:49.564510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:49.565117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:49.565445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:49.565706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:49.568200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:49.634837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:49.636259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:49.646219 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1244/2487] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:59:51.542453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928f37-44b5-4dca-ab10-152a76fbe1ad None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.542966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928f37-44b5-4dca-ab10-152a76fbe1ad None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.543063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928f37-44b5-4dca-ab10-152a76fbe1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.563450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-bd928f37-44b5-4dca-ab10-152a76fbe1ad None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:59:51.565350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bd928f37-44b5-4dca-ab10-152a76fbe1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:59:51.574259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1244/2488] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:59:51.586723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:59:51.598195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafb203-b752-4bc8-924d-58128ee287f1 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:59:51.603386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:59:51.603991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:59:51.604268 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:59:51.604548 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:59:51.613215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:59:51.614921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:59:51.622987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1245/2489] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 11:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:00:01.557534 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=58 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:01.619720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=76 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:17.078965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6a33-4f19-4b9a-b64f-24db02302153 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:17.079567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6a33-4f19-4b9a-b64f-24db02302153 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:17.079567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f6a33-4f19-4b9a-b64f-24db02302153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:17.110272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-941f6a33-4f19-4b9a-b64f-24db02302153 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:17.112396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-941f6a33-4f19-4b9a-b64f-24db02302153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:17.124740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1245/2490] 10.222.0.42 () {58 vars in 967 bytes} [Mon Sep 19 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:00:17.138278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:17.154396 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a20a6-efaa-43b2-a6f1-ef6b00c8e100 service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:17.165349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe05023-0613-4863-a593-bf71f291601f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:17.165911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe05023-0613-4863-a593-bf71f291601f service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:17.166221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe05023-0613-4863-a593-bf71f291601f service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:17.166455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe05023-0613-4863-a593-bf71f291601f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:17.176876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe05023-0613-4863-a593-bf71f291601f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:17.179118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe05023-0613-4863-a593-bf71f291601f service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:17.190139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1246/2491] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 12:00:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:00:27.101935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:27.184038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:40.292390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195711-b773-4b7f-8907-ee3bcce0712b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:40.292902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195711-b773-4b7f-8907-ee3bcce0712b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:40.292998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195711-b773-4b7f-8907-ee3bcce0712b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:40.311674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c9195711-b773-4b7f-8907-ee3bcce0712b None None] MFA Rules not processed for user `9cba47a204da4d49b6e6313052f4c579`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:40.312858 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c9195711-b773-4b7f-8907-ee3bcce0712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:40.367516 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1246/2492] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:00:50.360158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=25 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:57.212188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182016a5-99e4-4f4e-a80a-fe4b0813be9a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:57.212730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182016a5-99e4-4f4e-a80a-fe4b0813be9a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:57.212730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182016a5-99e4-4f4e-a80a-fe4b0813be9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:57.232160 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-182016a5-99e4-4f4e-a80a-fe4b0813be9a None None] MFA Rules not processed for user `5c395665e2ae44c4931ae90d2ab631ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:00:57.233394 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-182016a5-99e4-4f4e-a80a-fe4b0813be9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:57.289031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1247/2493] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:00:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:00:58.927364 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195711-b773-4b7f-8907-ee3bcce0712b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:00:58.937125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195711-b773-4b7f-8907-ee3bcce0712b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:00:58.941445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:00:58.942148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:00:58.942428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:00:58.942698 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:00:58.944402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:00:58.958728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:00:58.960144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:00:58.971047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1247/2494] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:00:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:01:00.082074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182016a5-99e4-4f4e-a80a-fe4b0813be9a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:00.093276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182016a5-99e4-4f4e-a80a-fe4b0813be9a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:00.097184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc7915-4577-48a7-ae32-671cb3c9c46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:00.097959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc7915-4577-48a7-ae32-671cb3c9c46c service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:00.098240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc7915-4577-48a7-ae32-671cb3c9c46c service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:00.098598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc7915-4577-48a7-ae32-671cb3c9c46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:00.100897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-aedc7915-4577-48a7-ae32-671cb3c9c46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:00.116024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc7915-4577-48a7-ae32-671cb3c9c46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:00.117455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc7915-4577-48a7-ae32-671cb3c9c46c service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:00.128177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1248/2495] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:01:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:01:08.966200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:10.123328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=31 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:26.628052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:26.629488 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:26.642996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881efeca-7caa-4a2e-8bae-4f7ab8622f12 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:26.649082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:26.650115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:26.650395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:26.650663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:26.652370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:26.710575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:26.712203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:26.721685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1248/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:01:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:01:34.958415 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:34.959015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:34.959320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:34.979422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] MFA Rules not processed for user `092e7d9f6d0f4c6984785e05162483ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:01:34.980604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:34.987357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1249/2497] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:01:35.293104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:35.302863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074af4-5e69-4943-b35d-1ae76a358664 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:35.306545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:35.307136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:35.307416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:35.307728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:35.309413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:35.318908 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:35.320840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:35.328586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1249/2498] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:01:35.646050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:35.647485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:35.666088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2becf9-72e6-4f65-a106-ed5be1809c5c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:35.671125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:35.671800 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:35.672140 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:35.672470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:35.674354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:35.687035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:35.688840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:35.700258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1250/2499] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:01:37.819839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:37.829424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f09ce-5bae-4b44-bb81-83f81b8e6754 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:37.833136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:37.833781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:37.834038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:37.834313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:37.837113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:37.847958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:37.849714 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:37.859244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1250/2500] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:01:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:01:38.583868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:38.585368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:38.603719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0bab-9490-49f1-8957-c068fac1e725 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:38.609210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:38.609812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:38.610093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:38.610364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:38.612087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:38.628321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:38.630055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:38.646981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1251/2501] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:01:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:01:44.218451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:01:44.219829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:44.277226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58956d-32d1-41e9-be5a-ed5a81f9852c service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:01:44.280795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:01:44.281424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:01:44.281699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:01:44.281965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:01:44.283672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:01:44.294397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:01:44.295813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:01:44.304658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1251/2502] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:01:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:01:48.641970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=15 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:54.300529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=66 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:05.099909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:05.109563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a4ea-342f-4783-b3fc-c5830c94461d service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:05.113124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:05.113736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:05.114013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:05.114281 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:05.116366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:05.180523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:05.182073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:05.192182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1252/2503] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:08.459657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:08.461183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:08.476061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12a57-c02d-46c2-b14a-4476cd19f2fc service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:08.481469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:08.482090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.482367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.482636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] PATH_INFO: `/v3/users/9cba47a204da4d49b6e6313052f4c579` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.483828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cba47a204da4d49b6e6313052f4c579)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.485871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.535960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cba47a204da4d49b6e6313052f4c579'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.543699 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cba47a204da4d49b6e6313052f4c579'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.544343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cba47a204da4d49b6e6313052f4c579'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.556570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cba47a204da4d49b6e6313052f4c579'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.563690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-98b00e50-9391-4d69-ad7d-c63bfbd4ce7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cba47a204da4d49b6e6313052f4c579'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.569531 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1252/2504] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:02:08 2022] DELETE /identity/v3/users/9cba47a204da4d49b6e6313052f4c579 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:02:08.746858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:08.759333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83341803-fc75-4922-a617-ca8de9a71b39 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:08.821041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:08.821690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.821962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.822229 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] PATH_INFO: `/v3/projects/aabef64303b8442db6510185a2e83b5e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.823347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabef64303b8442db6510185a2e83b5e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:08.825274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:08.877574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabef64303b8442db6510185a2e83b5e', 'request_id': 'req-d75fd754-c31c-47e0-8a11-3a8ac374a882'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.884995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabef64303b8442db6510185a2e83b5e', 'request_id': 'req-d75fd754-c31c-47e0-8a11-3a8ac374a882'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.891185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabef64303b8442db6510185a2e83b5e', 'request_id': 'req-d75fd754-c31c-47e0-8a11-3a8ac374a882'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.902824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] The token cache is being invalidate because project aabef64303b8442db6510185a2e83b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:02:08.903103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.903744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d75fd754-c31c-47e0-8a11-3a8ac374a882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:08.905231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1253/2505] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:02:08 2022] DELETE /identity/v3/projects/aabef64303b8442db6510185a2e83b5e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:02:08.911062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6e85-c1ba-4522-9a61-dc2bcccc5b7a None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:08.911348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6e85-c1ba-4522-9a61-dc2bcccc5b7a None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:08.911619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6e85-c1ba-4522-9a61-dc2bcccc5b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:08.931608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d2ea6e85-c1ba-4522-9a61-dc2bcccc5b7a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:08.933493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d2ea6e85-c1ba-4522-9a61-dc2bcccc5b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:08.991291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1253/2506] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:02:08.999944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969424f-d16f-4cbc-88cb-86ad69732d13 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.000231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969424f-d16f-4cbc-88cb-86ad69732d13 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.000506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969424f-d16f-4cbc-88cb-86ad69732d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.020331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9969424f-d16f-4cbc-88cb-86ad69732d13 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:09.021584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9969424f-d16f-4cbc-88cb-86ad69732d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:09.029603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1254/2507] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:02:09.033984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6e85-c1ba-4522-9a61-dc2bcccc5b7a None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.044382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6e85-c1ba-4522-9a61-dc2bcccc5b7a None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.048958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.049559 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.049839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.050141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.050790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:02:09.051090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.052678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.064738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1254/2508] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:02:09.069021 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969424f-d16f-4cbc-88cb-86ad69732d13 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.078538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969424f-d16f-4cbc-88cb-86ad69732d13 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.083037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.083615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.083885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.084149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.084796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.086699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.102270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:09.116200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1255/2509] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:02:09 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:02:09.120966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.130696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5fc83-0d84-45c2-84be-f3371071d959 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.186638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.187248 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.187556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.187833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.188481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.190438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.198486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:09.213180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1255/2510] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:02:09 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:02:09.217298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.230826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec29b-962c-418f-8d77-4156e54d84a3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.236429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.237044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.237356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.237633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.238377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.240023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.251293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1256/2511] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:02:09.255552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.265581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4909f5f-95c1-4a53-8e70-92bfd99cc920 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.270250 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eff76e-1e66-4955-a7ca-869a15d80916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.270839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eff76e-1e66-4955-a7ca-869a15d80916 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.271120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eff76e-1e66-4955-a7ca-869a15d80916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.271393 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eff76e-1e66-4955-a7ca-869a15d80916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.272036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eff76e-1e66-4955-a7ca-869a15d80916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.273678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eff76e-1e66-4955-a7ca-869a15d80916 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.284629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1256/2512] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:02:09.288889 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.299582 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7f8c-d6e2-4cd6-8bcb-d46a4bce0339 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.304141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.304779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.305055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.305357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] PATH_INFO: `/v3/projects/37a038dbcd5d45e0a30a37113995a8bc/users/8bab8f8c327d43e79bf5c6cf0a11549a/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.319813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a038dbcd5d45e0a30a37113995a8bc, user_id=8bab8f8c327d43e79bf5c6cf0a11549a, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.322702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.336972 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1257/2513] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:02:09 2022] PUT /identity/v3/projects/37a038dbcd5d45e0a30a37113995a8bc/users/8bab8f8c327d43e79bf5c6cf0a11549a/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:02:09.342929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23155b-18ea-4c85-a883-0877f8bf12c6 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.343218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23155b-18ea-4c85-a883-0877f8bf12c6 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.343582 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23155b-18ea-4c85-a883-0877f8bf12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.363768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3b23155b-18ea-4c85-a883-0877f8bf12c6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:09.364974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3b23155b-18ea-4c85-a883-0877f8bf12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:09.428328 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1257/2514] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:02:09.437973 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:09.439951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:09.499046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830748ad-c26f-4f96-8e98-a4ee276bd65d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:09.502669 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:09.503269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:09.503551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:09.503816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:09.512802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:09.514256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:09.523445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1258/2515] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:13.420593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204171fd-da8f-44e4-b51b-3a95356f79ec None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:13.421096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204171fd-da8f-44e4-b51b-3a95356f79ec None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:13.421279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204171fd-da8f-44e4-b51b-3a95356f79ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:13.462407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-204171fd-da8f-44e4-b51b-3a95356f79ec None None] MFA Rules not processed for user `8bab8f8c327d43e79bf5c6cf0a11549a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:13.463638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-204171fd-da8f-44e4-b51b-3a95356f79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:13.576850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1258/2516] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:02:13.584593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:13.586213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:13.691554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaae5a-ef58-406b-92e2-ec4d045db06d service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:13.698666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:13.699668 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:13.700132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:13.700567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:13.722386 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:13.724012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:13.736979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1259/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:15.054431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:15.054951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:15.055103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:15.076124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] MFA Rules not processed for user `8bab8f8c327d43e79bf5c6cf0a11549a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:15.077421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:15.084294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1259/2518] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:02:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:02:15.419421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:15.420982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:15.434058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22982daa-fc92-4b52-8fc6-4ab1909ee4aa service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:15.437920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:15.438608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:15.438850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:15.439127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:15.441752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:15.452117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:15.453578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:15.462499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1260/2519] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:25.070406 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:25.346018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:25.347396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:25.365254 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401367c-8b2e-4fb0-b4c0-0e06dab84b7f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:25.371568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:25.372173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:25.372453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:25.372810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:25.374587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:25.387758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:25.389125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:25.400069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1260/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:25.458197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:27.399216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:27.413009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3501e-8c3f-4a71-ae3d-4014fa42f71e service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:27.419122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde92b7c-a0dc-4220-bbd1-1376d17abac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:27.419711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92b7c-a0dc-4220-bbd1-1376d17abac5 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:27.419992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92b7c-a0dc-4220-bbd1-1376d17abac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:27.420307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92b7c-a0dc-4220-bbd1-1376d17abac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:27.422039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-dde92b7c-a0dc-4220-bbd1-1376d17abac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:27.481971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde92b7c-a0dc-4220-bbd1-1376d17abac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:27.483580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde92b7c-a0dc-4220-bbd1-1376d17abac5 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:27.492780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1261/2521] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:28.997350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:29.008600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f598-2c18-41e9-bc44-e663234c697b service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:29.015093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079766c-569c-433e-80f8-4840934686c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:29.015702 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079766c-569c-433e-80f8-4840934686c7 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:29.015979 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079766c-569c-433e-80f8-4840934686c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:29.016251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079766c-569c-433e-80f8-4840934686c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:29.018040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c079766c-569c-433e-80f8-4840934686c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:29.030860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079766c-569c-433e-80f8-4840934686c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:29.032474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079766c-569c-433e-80f8-4840934686c7 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:29.045775 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1261/2522] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:37.488302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=28 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:39.038689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=12 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:40.892754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:40.893269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:40.893387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:40.913756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] MFA Rules not processed for user `5c395665e2ae44c4931ae90d2ab631ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:40.914965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:40.921916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1262/2523] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:02:42.468617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:42.469097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:42.469224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:42.489846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:02:42.491320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:42.549045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1262/2524] 10.222.0.42 () {58 vars in 967 bytes} [Mon Sep 19 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:02:42.598813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:42.600264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:42.672934 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2d0cd-52b1-4957-9ff7-53cbe7388c35 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:42.678014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:42.678612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:42.678891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:42.679162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:42.687835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:42.689421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:42.697282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1263/2525] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 12:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:02:46.601278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:46.603403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:46.700525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c59961-8d2e-4c37-80e1-5812f1181950 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:46.705854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:46.706462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:46.706735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:46.707196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:46.708963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:46.721379 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:46.722970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:46.733925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1263/2526] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:02:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:02:50.218786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:50.222120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:50.239295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544617df-fb66-4ee1-928d-61472fb255c7 service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:50.244835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:50.246126 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:50.246584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:50.246856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] PATH_INFO: `/v3/users/3c3e932c283749d097943169ae7bc966` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:50.248016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3e932c283749d097943169ae7bc966)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:50.250412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:50.304719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3e932c283749d097943169ae7bc966'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.317578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3e932c283749d097943169ae7bc966'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.324486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3e932c283749d097943169ae7bc966'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.325052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3e932c283749d097943169ae7bc966'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.331912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3e932c283749d097943169ae7bc966'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.337780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1264/2527] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:02:50 2022] DELETE /identity/v3/users/3c3e932c283749d097943169ae7bc966 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:02:50.510020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:50.520739 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8380d-bfd5-44e7-8c34-106e06115999 service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:50.583534 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:50.584062 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:50.584337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:50.584606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] PATH_INFO: `/v3/projects/d5857b6e68c6418dbaaccd7d206c1760` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:50.585725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5857b6e68c6418dbaaccd7d206c1760)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:50.587621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:50.626913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:50.636230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5857b6e68c6418dbaaccd7d206c1760', 'request_id': 'req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.643175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5857b6e68c6418dbaaccd7d206c1760', 'request_id': 'req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.648577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5857b6e68c6418dbaaccd7d206c1760', 'request_id': 'req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.663124 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] The token cache is being invalidate because project d5857b6e68c6418dbaaccd7d206c1760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:02:50.663412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.664054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.665557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1264/2528] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:02:50 2022] DELETE /identity/v3/projects/d5857b6e68c6418dbaaccd7d206c1760 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:02:50.670343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:50.671725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:50.684727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049dd2-c622-4c32-bd78-6a41c0739a11 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:50.734312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:50.742122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:50.742748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:50.743385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:50.743874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] PATH_INFO: `/v3/users/42a9301bff7d48a7b3eef05242f185a2` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:50.745439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a9301bff7d48a7b3eef05242f185a2)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:50.747448 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:50.793314 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a9301bff7d48a7b3eef05242f185a2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.805284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a9301bff7d48a7b3eef05242f185a2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.812780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a9301bff7d48a7b3eef05242f185a2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.813473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a9301bff7d48a7b3eef05242f185a2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.820453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-26512a58-4bc4-475c-9cd0-a9fd960e8395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a9301bff7d48a7b3eef05242f185a2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:50.826345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1265/2529] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:02:50 2022] DELETE /identity/v3/users/42a9301bff7d48a7b3eef05242f185a2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:02:51.000697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:02:51.002182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:02:51.015447 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6d03c-787a-4acd-87e0-c7b4db6e9b86 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:02:51.080750 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:02:51.081400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:02:51.081683 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:02:51.081959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] PATH_INFO: `/v3/projects/f535b7a17f7e478ea4464b37e219a0f4` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:02:51.083071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f535b7a17f7e478ea4464b37e219a0f4)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:02:51.084971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:02:51.130815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f535b7a17f7e478ea4464b37e219a0f4', 'request_id': 'req-6ceef1d6-1310-4246-b009-f19a8e1434c9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:51.138019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f535b7a17f7e478ea4464b37e219a0f4', 'request_id': 'req-6ceef1d6-1310-4246-b009-f19a8e1434c9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:51.143690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f535b7a17f7e478ea4464b37e219a0f4', 'request_id': 'req-6ceef1d6-1310-4246-b009-f19a8e1434c9'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:51.155075 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] The token cache is being invalidate because project f535b7a17f7e478ea4464b37e219a0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:02:51.155356 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:51.155968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:02:51.157478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1265/2530] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:02:50 2022] DELETE /identity/v3/projects/f535b7a17f7e478ea4464b37e219a0f4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:03:00.822832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:01.152167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:29.462982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90621506-b6c3-4509-aa1f-7d9f7b66b517 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:29.463497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90621506-b6c3-4509-aa1f-7d9f7b66b517 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:29.463604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90621506-b6c3-4509-aa1f-7d9f7b66b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:29.485123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-90621506-b6c3-4509-aa1f-7d9f7b66b517 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:29.486351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-90621506-b6c3-4509-aa1f-7d9f7b66b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:29.541724 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1266/2531] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:29.553940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:29.555321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:29.626528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceef1d6-1310-4246-b009-f19a8e1434c9 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:29.631485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a454f-58ea-44a3-9b79-2831243f41f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:29.632085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a454f-58ea-44a3-9b79-2831243f41f2 service swift] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:29.632360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a454f-58ea-44a3-9b79-2831243f41f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:29.632628 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a454f-58ea-44a3-9b79-2831243f41f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:29.642608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a454f-58ea-44a3-9b79-2831243f41f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:29.644183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a454f-58ea-44a3-9b79-2831243f41f2 service swift] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:29.652939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1266/2532] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 12:03:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:03:39.534829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=25 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:39.649233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=32 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:43.940665 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ab2f5-624b-41a8-b058-d05082eb9d26 None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:43.941249 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ab2f5-624b-41a8-b058-d05082eb9d26 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:43.941522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ab2f5-624b-41a8-b058-d05082eb9d26 None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:43.943137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1267/2533] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 12:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:43.950247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240b03-2ae2-44fd-98e3-c4e960d55196 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:43.950737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240b03-2ae2-44fd-98e3-c4e960d55196 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:43.950954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240b03-2ae2-44fd-98e3-c4e960d55196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:43.971429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ca240b03-2ae2-44fd-98e3-c4e960d55196 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:43.972636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ca240b03-2ae2-44fd-98e3-c4e960d55196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.043603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1267/2534] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:44.055983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ab2f5-624b-41a8-b058-d05082eb9d26 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:44.058308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-869ab2f5-624b-41a8-b058-d05082eb9d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.119402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ab2f5-624b-41a8-b058-d05082eb9d26 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:44.122971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bf2a6-dfd6-4bca-a500-ea371ac591bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:44.123578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf2a6-dfd6-4bca-a500-ea371ac591bf service glance] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.123840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf2a6-dfd6-4bca-a500-ea371ac591bf service glance] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.124109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf2a6-dfd6-4bca-a500-ea371ac591bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.133985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bf2a6-dfd6-4bca-a500-ea371ac591bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:44.135409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bf2a6-dfd6-4bca-a500-ea371ac591bf service glance] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:44.145979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1268/2535] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:03:44.214779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81672b-fae3-47d1-8955-986a9bdb3081 None None] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.214934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81672b-fae3-47d1-8955-986a9bdb3081 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.215213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81672b-fae3-47d1-8955-986a9bdb3081 None None] PATH_INFO: `/` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.216576 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1268/2536] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 12:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:44.222460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2939f4-dc8c-4076-b0e6-99114bd7303c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.222771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2939f4-dc8c-4076-b0e6-99114bd7303c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.223197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2939f4-dc8c-4076-b0e6-99114bd7303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.243545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fb2939f4-dc8c-4076-b0e6-99114bd7303c None None] MFA Rules not processed for user `d84265ba2619438485db9a18f94c87aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:44.245043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fb2939f4-dc8c-4076-b0e6-99114bd7303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.295477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1269/2537] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:03:44.309489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81672b-fae3-47d1-8955-986a9bdb3081 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:44.311420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ba81672b-fae3-47d1-8955-986a9bdb3081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.324911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81672b-fae3-47d1-8955-986a9bdb3081 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:44.329102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf473fa-9dc8-430c-bb1e-b7c9d5b0724d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:44.329715 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf473fa-9dc8-430c-bb1e-b7c9d5b0724d service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.329990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf473fa-9dc8-430c-bb1e-b7c9d5b0724d service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.330260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf473fa-9dc8-430c-bb1e-b7c9d5b0724d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.337044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf473fa-9dc8-430c-bb1e-b7c9d5b0724d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:44.338481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf473fa-9dc8-430c-bb1e-b7c9d5b0724d service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:44.346240 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1269/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:03:44.429607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aa6a7-aaa2-42fd-adfa-472e257d7efe None None] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.429919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aa6a7-aaa2-42fd-adfa-472e257d7efe None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.430191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aa6a7-aaa2-42fd-adfa-472e257d7efe None None] PATH_INFO: `/` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.431542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1270/2539] 10.222.0.42 () {54 vars in 921 bytes} [Mon Sep 19 12:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 12:03:44.437497 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa034c-2095-43c4-bfa0-59f4e2433866 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.437786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa034c-2095-43c4-bfa0-59f4e2433866 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.438055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa034c-2095-43c4-bfa0-59f4e2433866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.458565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7baa034c-2095-43c4-bfa0-59f4e2433866 None None] MFA Rules not processed for user `84d136bca97e446a888c1b51a5b761a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:44.459766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7baa034c-2095-43c4-bfa0-59f4e2433866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.469127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1270/2540] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Sep 19 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:44.485776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aa6a7-aaa2-42fd-adfa-472e257d7efe None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:44.487491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fb8aa6a7-aaa2-42fd-adfa-472e257d7efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:44.501954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aa6a7-aaa2-42fd-adfa-472e257d7efe None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:44.505540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:44.506132 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:44.506409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:44.506679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:44.516521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:44.517969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:44.528445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1271/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:03:46.407783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d306-22ca-45be-b480-c1a6471d6397 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:46.408309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d306-22ca-45be-b480-c1a6471d6397 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:46.408434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0d306-22ca-45be-b480-c1a6471d6397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:46.428460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-bde0d306-22ca-45be-b480-c1a6471d6397 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:03:46.429736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bde0d306-22ca-45be-b480-c1a6471d6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:03:46.436917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1271/2542] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Sep 19 12:03:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:03:46.461845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:03:46.473997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736a52f-3a70-4f4e-b675-0212c8d23054 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:03:46.479052 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:03:46.479647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:03:46.479926 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:03:46.480224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:03:46.488979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:03:46.490579 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:03:46.498843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1272/2543] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 12:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:03:56.421950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=43 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:56.495526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=61 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:08.108551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:08.109036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:08.109130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:08.147928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] MFA Rules not processed for user `05244642112b4fa689f9924cf6c17e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:08.149128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:08.183204 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1272/2544] 10.222.0.42 () {58 vars in 967 bytes} [Mon Sep 19 12:04:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:08.197422 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:08.239864 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c8d0-ea45-41a3-8393-084ae561a71c service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:08.245583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '982dd41852574cd0a7db4184da3141ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:08.246182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:08.246456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:08.246727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:08.255472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:08.257045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:08.265300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1273/2545] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Sep 19 12:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 12:04:18.181430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=23 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:18.261927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=20 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:31.545484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:31.547719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:31.650061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0171eb8-b083-4f90-9c55-dbc1c65ff9d8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:31.661348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:31.661983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:31.662257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:31.662525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:31.664375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:31.676922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:31.678623 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:31.689469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1273/2546] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:37.378276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:37.398326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5d76-7bd3-495c-ac8d-f4a34a75a493 service swift] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:37.402012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:37.402604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:37.402882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:37.403175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:37.404870 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:37.489923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:37.491339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:37.511104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1274/2547] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:40.684613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:40.686205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:40.701119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb52181-76c7-4cd5-9beb-09c96515342d service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:40.706182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:40.706797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:40.707071 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:40.707338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] PATH_INFO: `/v3/users/5c395665e2ae44c4931ae90d2ab631ed` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:40.708498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c395665e2ae44c4931ae90d2ab631ed)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:40.710493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:40.758411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c395665e2ae44c4931ae90d2ab631ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:40.765717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c395665e2ae44c4931ae90d2ab631ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:40.766383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c395665e2ae44c4931ae90d2ab631ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:40.779201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c395665e2ae44c4931ae90d2ab631ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:40.786690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-8fce96d3-2bb6-46b1-aede-2904d9545029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c395665e2ae44c4931ae90d2ab631ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:40.792561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1274/2548] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:40 2022] DELETE /identity/v3/users/5c395665e2ae44c4931ae90d2ab631ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:40.965533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:40.977144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddd85a-1823-4257-867f-18cdc6d22850 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.035801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.036453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.036733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.037007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] PATH_INFO: `/v3/projects/3d1b6223025846c0ae5c69ff38e6f961` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.038164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1b6223025846c0ae5c69ff38e6f961)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.040048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.085283 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1b6223025846c0ae5c69ff38e6f961', 'request_id': 'req-c0d80752-775b-4048-8588-2eabcefd4bad'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:41.092912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1b6223025846c0ae5c69ff38e6f961', 'request_id': 'req-c0d80752-775b-4048-8588-2eabcefd4bad'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:41.094967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:41.100722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1b6223025846c0ae5c69ff38e6f961', 'request_id': 'req-c0d80752-775b-4048-8588-2eabcefd4bad'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:41.120365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] The token cache is being invalidate because project 3d1b6223025846c0ae5c69ff38e6f961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:41.120637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:41.121329 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c0d80752-775b-4048-8588-2eabcefd4bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:41.122817 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1275/2549] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:40 2022] DELETE /identity/v3/projects/3d1b6223025846c0ae5c69ff38e6f961 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:41.127874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c762c-e43a-42f2-8d6f-02ffe08b8cf8 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.128156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c762c-e43a-42f2-8d6f-02ffe08b8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.128428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c762c-e43a-42f2-8d6f-02ffe08b8cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.184920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-539c762c-e43a-42f2-8d6f-02ffe08b8cf8 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:41.186150 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-539c762c-e43a-42f2-8d6f-02ffe08b8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:41.191632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:41.245811 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1275/2550] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:41.254320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02c0c-be91-4a7c-8fe9-197a60678371 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.254605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02c0c-be91-4a7c-8fe9-197a60678371 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.254882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02c0c-be91-4a7c-8fe9-197a60678371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.274185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-2fb02c0c-be91-4a7c-8fe9-197a60678371 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:41.275391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-2fb02c0c-be91-4a7c-8fe9-197a60678371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:41.283225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1276/2551] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:41.287980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c762c-e43a-42f2-8d6f-02ffe08b8cf8 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:41.297546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c762c-e43a-42f2-8d6f-02ffe08b8cf8 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.302720 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.303294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.303571 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.303841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.304481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:04:41.304783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.306409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.317718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1276/2552] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:04:41.321791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02c0c-be91-4a7c-8fe9-197a60678371 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:41.330793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02c0c-be91-4a7c-8fe9-197a60678371 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.335431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.336014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.336292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.336564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.337212 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.339135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.366744 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1277/2553] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:41 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:41.371156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:41.381028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f73b7-91e6-47bc-b24a-fa47b4a72057 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.440459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.440962 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.441264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.441534 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.442156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.444057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.469539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1277/2554] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:41 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:41.474474 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:41.484790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfa7bb-db7d-4dd0-8bfc-03a626fd213c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.490093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.490875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.491321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.491595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.492240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.493891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.505107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1278/2555] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:41.509669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:41.521039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3567e4-6f4d-44d5-a117-0d0b78c3c36c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.525855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d081fc-716c-4214-a7bd-2c04b9635690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.526574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d081fc-716c-4214-a7bd-2c04b9635690 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.526855 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d081fc-716c-4214-a7bd-2c04b9635690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.527125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d081fc-716c-4214-a7bd-2c04b9635690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.527949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d081fc-716c-4214-a7bd-2c04b9635690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.529590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d081fc-716c-4214-a7bd-2c04b9635690 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.542847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1278/2556] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:41.547047 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:41.557172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d801-be6e-436c-8bb8-5b63993a38a8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.561764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.562411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.562684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.562959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] PATH_INFO: `/v3/projects/5dbcbb6941f4440686d5e3af6cbd044f/users/14c3e4aa8c8949628b02da589fb68363/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.586723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbcbb6941f4440686d5e3af6cbd044f, user_id=14c3e4aa8c8949628b02da589fb68363, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.589392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.603781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1279/2557] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:41 2022] PUT /identity/v3/projects/5dbcbb6941f4440686d5e3af6cbd044f/users/14c3e4aa8c8949628b02da589fb68363/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:41.614181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcbb85-1cf0-4028-9f08-12c91f23b400 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.614458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcbb85-1cf0-4028-9f08-12c91f23b400 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.614723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcbb85-1cf0-4028-9f08-12c91f23b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.642565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fcfcbb85-1cf0-4028-9f08-12c91f23b400 None None] MFA Rules not processed for user `14c3e4aa8c8949628b02da589fb68363`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:41.644475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fcfcbb85-1cf0-4028-9f08-12c91f23b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:41.707860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1279/2558] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:41.718887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:41.720581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:41.814590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f06f5-9d8d-41fb-9e00-ab437f72cc58 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:41.820860 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe58f-362c-420f-bfef-d878bb023bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:41.821487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe58f-362c-420f-bfef-d878bb023bf1 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:41.821768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe58f-362c-420f-bfef-d878bb023bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:41.822040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe58f-362c-420f-bfef-d878bb023bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:41.829704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe58f-362c-420f-bfef-d878bb023bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:41.831841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe58f-362c-420f-bfef-d878bb023bf1 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:41.840538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1280/2559] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:42.051197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcbb85-1cf0-4028-9f08-12c91f23b400 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:42.059794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:42.115735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcbb85-1cf0-4028-9f08-12c91f23b400 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:42.120478 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:42.121098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.121400 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.121664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] PATH_INFO: `/v3/users/14c3e4aa8c8949628b02da589fb68363` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.122759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c3e4aa8c8949628b02da589fb68363)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:42.124647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:42.171225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c3e4aa8c8949628b02da589fb68363'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.178953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c3e4aa8c8949628b02da589fb68363'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.179583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c3e4aa8c8949628b02da589fb68363'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.194320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c3e4aa8c8949628b02da589fb68363'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.201304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c3e4aa8c8949628b02da589fb68363'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.207103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1280/2560] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:42 2022] DELETE /identity/v3/users/14c3e4aa8c8949628b02da589fb68363 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:42.211672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.212147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.212147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.231111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:42.232291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:42.276250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:42.293078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1281/2561] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:42.303410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:42.304779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:42.372851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca83742-5981-4904-a84a-f4cff3fce551 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:42.376581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db119b-a503-4c72-8c58-d9483b900d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:42.377198 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db119b-a503-4c72-8c58-d9483b900d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.378106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db119b-a503-4c72-8c58-d9483b900d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.378378 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db119b-a503-4c72-8c58-d9483b900d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.387256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db119b-a503-4c72-8c58-d9483b900d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:42.388669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db119b-a503-4c72-8c58-d9483b900d2f service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:42.398286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1281/2562] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:42.673593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:42.675872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:42.688894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baded4-cd18-4a82-b28c-1b08b06cca97 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:42.694131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:42.694764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.695043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.695316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] PATH_INFO: `/v3/projects/5dbcbb6941f4440686d5e3af6cbd044f` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.697135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbcbb6941f4440686d5e3af6cbd044f)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:42.699071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:42.746886 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbcbb6941f4440686d5e3af6cbd044f', 'request_id': 'req-f92f8b21-3f66-48c4-80fa-e84d0a93124b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.754125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbcbb6941f4440686d5e3af6cbd044f', 'request_id': 'req-f92f8b21-3f66-48c4-80fa-e84d0a93124b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.759910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbcbb6941f4440686d5e3af6cbd044f', 'request_id': 'req-f92f8b21-3f66-48c4-80fa-e84d0a93124b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.770863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] The token cache is being invalidate because project 5dbcbb6941f4440686d5e3af6cbd044f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:42.771149 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.771776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-f92f8b21-3f66-48c4-80fa-e84d0a93124b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:42.773307 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1282/2563] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:42 2022] DELETE /identity/v3/projects/5dbcbb6941f4440686d5e3af6cbd044f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:42.778136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a6a4-042e-4db3-a270-e675338d0760 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.778588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a6a4-042e-4db3-a270-e675338d0760 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.778700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a6a4-042e-4db3-a270-e675338d0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.800330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-d870a6a4-042e-4db3-a270-e675338d0760 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:42.801565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d870a6a4-042e-4db3-a270-e675338d0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:42.813705 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:42.863044 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1282/2564] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:42.871155 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3919de-d2e5-4d38-8bbb-a812272a8df6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.871433 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3919de-d2e5-4d38-8bbb-a812272a8df6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.871701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3919de-d2e5-4d38-8bbb-a812272a8df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.891598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-bf3919de-d2e5-4d38-8bbb-a812272a8df6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:42.892815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bf3919de-d2e5-4d38-8bbb-a812272a8df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:42.901216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1283/2565] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:42.905513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a6a4-042e-4db3-a270-e675338d0760 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:42.915434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a6a4-042e-4db3-a270-e675338d0760 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:42.919991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:42.920580 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.920859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.921132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.921798 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:04:42.922099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:42.923690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:42.935109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1283/2566] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:04:42.939335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3919de-d2e5-4d38-8bbb-a812272a8df6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:42.948488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3919de-d2e5-4d38-8bbb-a812272a8df6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:42.953185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:42.953776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:42.954054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:42.954328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:42.954962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:42.957645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:42.985206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1284/2567] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:42 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:42.989551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:42.999885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f1f4-2748-4757-9330-9a40ca1db16b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.056608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.057239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.057518 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.057791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.058416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.060313 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.081585 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1284/2568] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:42 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:43.085821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.096854 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37371200-8dcc-468d-9867-e6486aa3e774 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.101553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.102139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.102416 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.102683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.103319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.104891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.115486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1285/2569] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:43.119825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.130837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba1e40-4193-4dc7-9c34-2266b98dca1e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.135445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527088f9-01a4-4358-a0e0-08501c50fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.136034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527088f9-01a4-4358-a0e0-08501c50fba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.136309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527088f9-01a4-4358-a0e0-08501c50fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.136576 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527088f9-01a4-4358-a0e0-08501c50fba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.137251 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527088f9-01a4-4358-a0e0-08501c50fba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.138820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527088f9-01a4-4358-a0e0-08501c50fba8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.149520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1285/2570] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:43.153809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.163830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462f3f3-97f9-4f77-a714-285bdf499596 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.168598 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.169273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.169567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.169834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] PATH_INFO: `/v3/projects/7dff8afa7d2541d28d1f41270ebb52c8/users/5e8cded28077461a865d230488c01e5b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.184995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dff8afa7d2541d28d1f41270ebb52c8, user_id=5e8cded28077461a865d230488c01e5b, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.187630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.201558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1286/2571] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:43 2022] PUT /identity/v3/projects/7dff8afa7d2541d28d1f41270ebb52c8/users/5e8cded28077461a865d230488c01e5b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:43.213671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c43e-e79e-415a-ac23-3842d27fca20 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.213957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c43e-e79e-415a-ac23-3842d27fca20 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.214233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c43e-e79e-415a-ac23-3842d27fca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.242396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-3ef8c43e-e79e-415a-ac23-3842d27fca20 None None] MFA Rules not processed for user `5e8cded28077461a865d230488c01e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:43.243599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3ef8c43e-e79e-415a-ac23-3842d27fca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:43.307898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1286/2572] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:43.312569 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.374557 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b5e4-89e2-4468-af6c-5963ddfa9744 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.379236 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.379825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.380103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.380374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.381007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.382939 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.396989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:43.411337 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1287/2573] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:43 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:43.415475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8c43e-e79e-415a-ac23-3842d27fca20 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.427325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8c43e-e79e-415a-ac23-3842d27fca20 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.436278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:43.484817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.485440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.485719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.485991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.487226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.489303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.512591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1287/2574] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:43 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:43.514055 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.524427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff00dc-4dca-4a12-9ecf-29bd4d7aa929 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.529339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.530120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.530407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.530793 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.531442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.533029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.544270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1288/2575] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:43.548373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.558863 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41f399-213f-4ce4-aeb5-6c9bdbc0cf53 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.563421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.564055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.564355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.564613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] PATH_INFO: `/v3/projects/19c9ec79065b4d97bca27e808096e7a3/users/62d80203ef4e4da793a87d1dccc6de9c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.579126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c9ec79065b4d97bca27e808096e7a3, user_id=62d80203ef4e4da793a87d1dccc6de9c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.582203 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.594754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1288/2576] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:43 2022] PUT /identity/v3/projects/19c9ec79065b4d97bca27e808096e7a3/users/62d80203ef4e4da793a87d1dccc6de9c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:43.599381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.609285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8df89-47c6-4964-aba5-47d5d5346c67 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.668591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd769de-4e6f-481d-b7f8-ed2c88f2bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.669264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd769de-4e6f-481d-b7f8-ed2c88f2bbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.669540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd769de-4e6f-481d-b7f8-ed2c88f2bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.669826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd769de-4e6f-481d-b7f8-ed2c88f2bbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.670452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd769de-4e6f-481d-b7f8-ed2c88f2bbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.672024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd769de-4e6f-481d-b7f8-ed2c88f2bbbb admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.681842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1289/2577] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:43.685927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.696060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9281d-e25c-46e8-864d-4b766af25b2a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.701108 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.701838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.702221 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.702602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] PATH_INFO: `/v3/projects/19c9ec79065b4d97bca27e808096e7a3/users/62d80203ef4e4da793a87d1dccc6de9c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.704529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c9ec79065b4d97bca27e808096e7a3, user_id=62d80203ef4e4da793a87d1dccc6de9c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.707757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.718243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1289/2578] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:43 2022] PUT /identity/v3/projects/19c9ec79065b4d97bca27e808096e7a3/users/62d80203ef4e4da793a87d1dccc6de9c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:43.729251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da16ec-22de-4f08-9629-c40054d4de1d None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.729619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da16ec-22de-4f08-9629-c40054d4de1d None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.729894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da16ec-22de-4f08-9629-c40054d4de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.757868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-40da16ec-22de-4f08-9629-c40054d4de1d None None] MFA Rules not processed for user `62d80203ef4e4da793a87d1dccc6de9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:43.759081 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-40da16ec-22de-4f08-9629-c40054d4de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:43.828362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1290/2579] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:43.842208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:43.843930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:43.923736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470140-15fe-488a-9bc3-bea4e2b3975e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:43.927677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:43.928266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:43.928538 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:43.928803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:43.937890 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:43.939355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:43.949027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1290/2580] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:04:44.024477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da16ec-22de-4f08-9629-c40054d4de1d None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:44.034077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da16ec-22de-4f08-9629-c40054d4de1d None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:44.037603 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad891675-eede-4340-85b0-28e258a63565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:44.038198 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad891675-eede-4340-85b0-28e258a63565 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:44.038499 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad891675-eede-4340-85b0-28e258a63565 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:44.038774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad891675-eede-4340-85b0-28e258a63565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:44.095254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad891675-eede-4340-85b0-28e258a63565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:44.096601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad891675-eede-4340-85b0-28e258a63565 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:44.105491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1291/2581] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:46.820033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:46.868327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:46.883525 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b15ea-2e9f-49e2-8020-6c95724d0d1d service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:46.888092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:46.888704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:46.888977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:46.889278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] PATH_INFO: `/v3/users/5e8cded28077461a865d230488c01e5b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:46.890369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8cded28077461a865d230488c01e5b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:46.892255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:46.938735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8cded28077461a865d230488c01e5b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:46.946877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8cded28077461a865d230488c01e5b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:46.947615 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8cded28077461a865d230488c01e5b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:46.959338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8cded28077461a865d230488c01e5b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:46.966081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8cded28077461a865d230488c01e5b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:46.972310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1291/2582] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:46 2022] DELETE /identity/v3/users/5e8cded28077461a865d230488c01e5b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:46.976891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:46.977381 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:46.977476 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:46.984440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:47.000156 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:47.001382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:47.060136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1292/2583] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:04:47.069807 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:47.071192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:47.129600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a13d08-1d96-4146-9814-4e5dd07bf211 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:47.133289 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:47.133883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:47.134164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:47.134430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:47.143300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:47.144710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:47.153893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1292/2584] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:47.421177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:47.422662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:47.436748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a8f9-4e62-438c-a9b0-975ea67e4944 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:47.441730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:47.442997 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:47.443277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:47.443715 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] PATH_INFO: `/v3/projects/7dff8afa7d2541d28d1f41270ebb52c8` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:47.444852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dff8afa7d2541d28d1f41270ebb52c8)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:47.446777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:47.494466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dff8afa7d2541d28d1f41270ebb52c8', 'request_id': 'req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.501621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dff8afa7d2541d28d1f41270ebb52c8', 'request_id': 'req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.507238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dff8afa7d2541d28d1f41270ebb52c8', 'request_id': 'req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.518590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] The token cache is being invalidate because project 7dff8afa7d2541d28d1f41270ebb52c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:47.518965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.519623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.521100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1293/2585] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:47 2022] DELETE /identity/v3/projects/7dff8afa7d2541d28d1f41270ebb52c8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:47.525053 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:47.535278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6a7e7-14f3-494b-b8bf-e5ea1adf1e1c service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:47.589742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:47.590362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:47.590639 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:47.590917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] PATH_INFO: `/v3/users/62d80203ef4e4da793a87d1dccc6de9c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:47.592034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d80203ef4e4da793a87d1dccc6de9c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:47.594023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:47.606876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:47.641774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d80203ef4e4da793a87d1dccc6de9c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.649403 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d80203ef4e4da793a87d1dccc6de9c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.654086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d80203ef4e4da793a87d1dccc6de9c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.663386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d80203ef4e4da793a87d1dccc6de9c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.670213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-e1664cd3-a120-4d81-980e-d2bcc738729e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d80203ef4e4da793a87d1dccc6de9c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:47.676193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1293/2586] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:47 2022] DELETE /identity/v3/users/62d80203ef4e4da793a87d1dccc6de9c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:47.944857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:47.946418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:47.961009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01d25-4cdc-4537-8d3c-f966aa7bfa2b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.019769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.020406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.020655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.020980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] PATH_INFO: `/v3/projects/19c9ec79065b4d97bca27e808096e7a3` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.022078 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c9ec79065b4d97bca27e808096e7a3)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.023978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.054264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:48.071498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c9ec79065b4d97bca27e808096e7a3', 'request_id': 'req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:48.078882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c9ec79065b4d97bca27e808096e7a3', 'request_id': 'req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:48.085063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c9ec79065b4d97bca27e808096e7a3', 'request_id': 'req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:48.096619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] The token cache is being invalidate because project 19c9ec79065b4d97bca27e808096e7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:48.096898 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:48.097585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-81816901-4d1a-4b8e-ae0b-a3be6bfa2d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:48.099088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1294/2587] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:47 2022] DELETE /identity/v3/projects/19c9ec79065b4d97bca27e808096e7a3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:48.105653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338d1d-6342-4c4c-937e-8e4865b9cc25 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.106136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338d1d-6342-4c4c-937e-8e4865b9cc25 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.106229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338d1d-6342-4c4c-937e-8e4865b9cc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.125838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-fc338d1d-6342-4c4c-937e-8e4865b9cc25 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:48.127051 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-fc338d1d-6342-4c4c-937e-8e4865b9cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:48.185229 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1294/2588] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:48.195112 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432f0d-8580-4fb8-9693-5eb11cf0e389 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.195397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432f0d-8580-4fb8-9693-5eb11cf0e389 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.195671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89432f0d-8580-4fb8-9693-5eb11cf0e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.215343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-89432f0d-8580-4fb8-9693-5eb11cf0e389 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:48.216531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-89432f0d-8580-4fb8-9693-5eb11cf0e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:48.224738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1295/2589] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:48.228923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc338d1d-6342-4c4c-937e-8e4865b9cc25 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.240012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc338d1d-6342-4c4c-937e-8e4865b9cc25 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.245342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.245935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.246315 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.246587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.247226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:04:48.247523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.249249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.261925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1295/2590] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:04:48.266238 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432f0d-8580-4fb8-9693-5eb11cf0e389 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.275761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89432f0d-8580-4fb8-9693-5eb11cf0e389 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.280321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.280906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.281214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.281492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.282130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.284032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.311233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1296/2591] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:48.320770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.330954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eba5b0-f257-411d-ac2b-dda2d4e2569e admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.386900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.387498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.387778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.388055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.388685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.390622 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.412244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1296/2592] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:48.416345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.427099 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0c3c-0bd1-48b9-951a-2edd97a541fe admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.431812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.432406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.432687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.432959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.433647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.435224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.445630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1297/2593] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:48.449757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.462971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be36942-986e-4ef0-8008-9ee7469db4cd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.467599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01d5b2-8304-4572-918b-a99cf02fa0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.468193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d5b2-8304-4572-918b-a99cf02fa0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.468471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d5b2-8304-4572-918b-a99cf02fa0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.468743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d5b2-8304-4572-918b-a99cf02fa0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.469426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01d5b2-8304-4572-918b-a99cf02fa0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.471029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01d5b2-8304-4572-918b-a99cf02fa0e6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.472318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:48.486024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1297/2594] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:48.488200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.498217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb587a66-f773-47ca-acb7-49135ba09f93 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.503682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.504321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.504596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.504863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] PATH_INFO: `/v3/projects/7092b974ff084f689462a10d4c3a263d/users/e45a2e07f6e94369af8c65e561baab9e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.519256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7092b974ff084f689462a10d4c3a263d, user_id=e45a2e07f6e94369af8c65e561baab9e, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.521921 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.539885 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1298/2595] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:48 2022] PUT /identity/v3/projects/7092b974ff084f689462a10d4c3a263d/users/e45a2e07f6e94369af8c65e561baab9e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:04:48.546423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fd32-f6db-4835-9731-f928ca49a91f None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.546731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fd32-f6db-4835-9731-f928ca49a91f None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.547002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fd32-f6db-4835-9731-f928ca49a91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.574782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ac63fd32-f6db-4835-9731-f928ca49a91f None None] MFA Rules not processed for user `e45a2e07f6e94369af8c65e561baab9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:48.575976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ac63fd32-f6db-4835-9731-f928ca49a91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:48.639651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1298/2596] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:48.644458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.710104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd1fd-7f09-4767-a472-d623cc36b707 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.714749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.715347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.715629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.715904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.716543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.718479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.745798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1299/2597] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:04:48.749841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fd32-f6db-4835-9731-f928ca49a91f None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.760543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fd32-f6db-4835-9731-f928ca49a91f None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.815806 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.816397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.816670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.816940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.817598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.819465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.839418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1299/2598] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:48.843487 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.854577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5f4d9-cbec-415e-bd44-29ddd93e8df2 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.859237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.859831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.860109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.860382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.861013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.863221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.873962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1300/2599] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:48.878020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.887831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db33ad-f69c-457b-af9a-948550cb7d87 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.892440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7165d2c-8e83-4d94-8f50-6c9cd9a445e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.893711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7165d2c-8e83-4d94-8f50-6c9cd9a445e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.893990 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7165d2c-8e83-4d94-8f50-6c9cd9a445e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.894257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7165d2c-8e83-4d94-8f50-6c9cd9a445e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.894899 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7165d2c-8e83-4d94-8f50-6c9cd9a445e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.896506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7165d2c-8e83-4d94-8f50-6c9cd9a445e7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.906284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1300/2600] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:48.911003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:48.920739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a70504-1a70-4d81-9daf-3634eb3e6966 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:48.926093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:48.926859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.927197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.927472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] PATH_INFO: `/v3/projects/b2fb9d8c707c4b4c8dbf8e12e35822fb/users/14e191e1772349769a36a2bd71755379/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.943650 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fb9d8c707c4b4c8dbf8e12e35822fb, user_id=14e191e1772349769a36a2bd71755379, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:48.946306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:48.958786 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1301/2601] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:48 2022] PUT /identity/v3/projects/b2fb9d8c707c4b4c8dbf8e12e35822fb/users/14e191e1772349769a36a2bd71755379/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:48.968968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d409b-0ca6-437e-b403-c2b8397b22c0 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:48.969291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d409b-0ca6-437e-b403-c2b8397b22c0 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:48.969575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d409b-0ca6-437e-b403-c2b8397b22c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:48.997411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-152d409b-0ca6-437e-b403-c2b8397b22c0 None None] MFA Rules not processed for user `14e191e1772349769a36a2bd71755379`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:48.998665 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-152d409b-0ca6-437e-b403-c2b8397b22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:49.052877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:49.063873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1301/2602] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:49.069070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.073383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:49.133757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c743f-1dac-4fb3-9f60-8fe4949665ff admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.138460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.139054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.139334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.139605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.140223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.142142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.168144 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1302/2603] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:49 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:49.172350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d409b-0ca6-437e-b403-c2b8397b22c0 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.183459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d409b-0ca6-437e-b403-c2b8397b22c0 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.240551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.241182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.241465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.241737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.242370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.244536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.265920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1302/2604] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:49 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:49.270116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.280276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07670b-05fd-4a5b-ad06-c4ad35351cbc admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.285486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.286074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.286348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.286615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.287251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.288827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.299849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1303/2605] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:49.303776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.313539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c8eee-11e9-4c58-85b0-4f877e595536 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.319007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.319688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.319910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.320177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] PATH_INFO: `/v3/projects/c38ccdbc87774f7a9e9aeebd36b3012d/users/0085037415a94fb5b003209fb785fc65/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.335587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38ccdbc87774f7a9e9aeebd36b3012d, user_id=0085037415a94fb5b003209fb785fc65, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.338470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.351061 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1303/2606] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:49 2022] PUT /identity/v3/projects/c38ccdbc87774f7a9e9aeebd36b3012d/users/0085037415a94fb5b003209fb785fc65/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:49.354965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.364883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774185fd-2630-4051-95ad-2c680e46be63 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.421142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158555e9-180f-47bb-a294-8a32059e9f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.421765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158555e9-180f-47bb-a294-8a32059e9f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.422040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158555e9-180f-47bb-a294-8a32059e9f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.422309 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158555e9-180f-47bb-a294-8a32059e9f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.422943 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158555e9-180f-47bb-a294-8a32059e9f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.424633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158555e9-180f-47bb-a294-8a32059e9f15 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.434254 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1304/2607] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:49.438598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.449237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb8ecb-6171-4ffc-8ff8-0fb6b156f0d6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.454112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.454752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.455026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.455329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] PATH_INFO: `/v3/projects/c38ccdbc87774f7a9e9aeebd36b3012d/users/0085037415a94fb5b003209fb785fc65/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.458016 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38ccdbc87774f7a9e9aeebd36b3012d, user_id=0085037415a94fb5b003209fb785fc65, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.460654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.471008 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1304/2608] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:49 2022] PUT /identity/v3/projects/c38ccdbc87774f7a9e9aeebd36b3012d/users/0085037415a94fb5b003209fb785fc65/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:04:49.482117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.482406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.482678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.510632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] MFA Rules not processed for user `0085037415a94fb5b003209fb785fc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:49.511863 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:49.574848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:49.582423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1305/2609] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:49.593358 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.595060 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:49.653485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32e48-b67a-4b52-bdb4-1057fd212252 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.660013 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.660730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.660882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.661169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.670322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.671759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.682179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1305/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:49.724048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:49.725454 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:49.738670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fec615-9ad5-4978-a2b6-2e3dc3137268 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:49.742488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d311219-c129-444f-a050-b7ff0e4a816c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:49.743080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311219-c129-444f-a050-b7ff0e4a816c service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:49.743350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311219-c129-444f-a050-b7ff0e4a816c service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:49.743618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311219-c129-444f-a050-b7ff0e4a816c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:49.800915 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d311219-c129-444f-a050-b7ff0e4a816c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:49.802369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d311219-c129-444f-a050-b7ff0e4a816c service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:49.811133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1306/2611] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:52.701892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:52.750416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:52.764966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172e42a-5a87-485f-ae2a-39b103ab8364 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:52.770057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:52.770678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:52.770956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:52.771225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] PATH_INFO: `/v3/users/e45a2e07f6e94369af8c65e561baab9e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:52.772335 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45a2e07f6e94369af8c65e561baab9e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:52.774300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:52.821872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45a2e07f6e94369af8c65e561baab9e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:52.828972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45a2e07f6e94369af8c65e561baab9e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:52.829846 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45a2e07f6e94369af8c65e561baab9e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:52.842679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45a2e07f6e94369af8c65e561baab9e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:52.850223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45a2e07f6e94369af8c65e561baab9e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:52.856066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1306/2612] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:52 2022] DELETE /identity/v3/users/e45a2e07f6e94369af8c65e561baab9e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:52.860871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:52.861364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:52.861471 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:52.880341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:52.881571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:52.940428 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1307/2613] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:52.950822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:52.952292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:53.010343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31ae38-620c-457c-b721-a16904233fa2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:53.014000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:53.014595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:53.014874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:53.015146 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:53.024213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:53.025678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:53.035415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1307/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:04:53.309225 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:53.310626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:53.323641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80f3f4-557b-42e6-9de4-706b75820de1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:53.328371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:53.329004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:53.329365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:53.329644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] PATH_INFO: `/v3/projects/7092b974ff084f689462a10d4c3a263d` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:53.331497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7092b974ff084f689462a10d4c3a263d)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:53.333923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:53.381993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7092b974ff084f689462a10d4c3a263d', 'request_id': 'req-eae46911-6183-4fd1-a253-14c92706aac3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.389387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7092b974ff084f689462a10d4c3a263d', 'request_id': 'req-eae46911-6183-4fd1-a253-14c92706aac3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.395626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7092b974ff084f689462a10d4c3a263d', 'request_id': 'req-eae46911-6183-4fd1-a253-14c92706aac3'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.406552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] The token cache is being invalidate because project 7092b974ff084f689462a10d4c3a263d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:53.406696 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.407374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.408948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1308/2615] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:53 2022] DELETE /identity/v3/projects/7092b974ff084f689462a10d4c3a263d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:53.414086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:53.423653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e810c-114f-4706-bcc5-867ad0adc096 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:53.479794 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:53.480462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:53.480737 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:53.481007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] PATH_INFO: `/v3/users/14e191e1772349769a36a2bd71755379` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:53.482142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e191e1772349769a36a2bd71755379)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:53.484056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:53.496407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:53.528262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e191e1772349769a36a2bd71755379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.535774 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e191e1772349769a36a2bd71755379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.536470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e191e1772349769a36a2bd71755379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.548173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e191e1772349769a36a2bd71755379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.554958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e191e1772349769a36a2bd71755379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.560697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1308/2616] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:53 2022] DELETE /identity/v3/users/14e191e1772349769a36a2bd71755379 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:53.833242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:53.834948 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:53.848520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae46911-6183-4fd1-a253-14c92706aac3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:53.867912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:53.910494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:53.911045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:53.911328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:53.911600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] PATH_INFO: `/v3/projects/b2fb9d8c707c4b4c8dbf8e12e35822fb` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:53.912737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fb9d8c707c4b4c8dbf8e12e35822fb)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:53.914666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:53.961852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fb9d8c707c4b4c8dbf8e12e35822fb', 'request_id': 'req-bd8479ee-845f-4974-9395-1714e9325f6d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.969214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fb9d8c707c4b4c8dbf8e12e35822fb', 'request_id': 'req-bd8479ee-845f-4974-9395-1714e9325f6d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.974787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fb9d8c707c4b4c8dbf8e12e35822fb', 'request_id': 'req-bd8479ee-845f-4974-9395-1714e9325f6d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.985672 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] The token cache is being invalidate because project b2fb9d8c707c4b4c8dbf8e12e35822fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:53.985954 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.986576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:53.988067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1309/2617] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:53 2022] DELETE /identity/v3/projects/b2fb9d8c707c4b4c8dbf8e12e35822fb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:04:53.992111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:53.993627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:54.007033 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262c3ef-f96a-4e5d-b72b-e23b3dee90e7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.062310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.062933 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.063212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.063484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] PATH_INFO: `/v3/users/0085037415a94fb5b003209fb785fc65` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.064599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0085037415a94fb5b003209fb785fc65)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.067226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:54.111297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0085037415a94fb5b003209fb785fc65'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.119680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0085037415a94fb5b003209fb785fc65'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.120311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0085037415a94fb5b003209fb785fc65'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.133105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0085037415a94fb5b003209fb785fc65'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.140068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-527b11d4-4d27-4de2-96a0-f3a123431528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0085037415a94fb5b003209fb785fc65'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.146208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1309/2618] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:53 2022] DELETE /identity/v3/users/0085037415a94fb5b003209fb785fc65 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:54.416303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:54.417796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:54.431083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8479ee-845f-4974-9395-1714e9325f6d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.499435 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.500063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.500340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.500616 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] PATH_INFO: `/v3/projects/c38ccdbc87774f7a9e9aeebd36b3012d` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.501747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38ccdbc87774f7a9e9aeebd36b3012d)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.503732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:54.549361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38ccdbc87774f7a9e9aeebd36b3012d', 'request_id': 'req-4437a83c-14da-4380-87d7-b24c07898f3f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.552618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:54.557812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38ccdbc87774f7a9e9aeebd36b3012d', 'request_id': 'req-4437a83c-14da-4380-87d7-b24c07898f3f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.564285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38ccdbc87774f7a9e9aeebd36b3012d', 'request_id': 'req-4437a83c-14da-4380-87d7-b24c07898f3f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.575246 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] The token cache is being invalidate because project c38ccdbc87774f7a9e9aeebd36b3012d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:54.575528 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.576162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-4437a83c-14da-4380-87d7-b24c07898f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:54.577657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1310/2619] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:54 2022] DELETE /identity/v3/projects/c38ccdbc87774f7a9e9aeebd36b3012d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:54.583532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6f5af-b8ae-474e-98ca-1c47b2e8959b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.583817 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6f5af-b8ae-474e-98ca-1c47b2e8959b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.584091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6f5af-b8ae-474e-98ca-1c47b2e8959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.604201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9ac6f5af-b8ae-474e-98ca-1c47b2e8959b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:54.605440 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9ac6f5af-b8ae-474e-98ca-1c47b2e8959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:54.609555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:54.667670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1310/2620] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:54.676420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128aaa-b555-4bae-8895-b7d3567c3667 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.676701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128aaa-b555-4bae-8895-b7d3567c3667 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.676976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128aaa-b555-4bae-8895-b7d3567c3667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.696494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b4128aaa-b555-4bae-8895-b7d3567c3667 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:54.697745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b4128aaa-b555-4bae-8895-b7d3567c3667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:54.705608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1311/2621] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:04:54.709768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6f5af-b8ae-474e-98ca-1c47b2e8959b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:54.719286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6f5af-b8ae-474e-98ca-1c47b2e8959b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.724604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.725239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.725523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.725791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.726486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:04:54.726787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.728413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:54.740573 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1311/2622] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:04:54.745373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4128aaa-b555-4bae-8895-b7d3567c3667 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:54.754564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4128aaa-b555-4bae-8895-b7d3567c3667 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.759233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.759821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.760097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.760366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.760986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.762900 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:54.789843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1312/2623] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:54 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:54.794007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:54.804652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ebe40-2fdd-499b-a074-648cb3d09494 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.859333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.859927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.860201 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.860468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.861098 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.863565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:54.884342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1312/2624] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:54 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:54.888661 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:54.899594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805be9-025e-4d11-8286-25fec07e4139 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.904201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.904791 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.905067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.905373 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.906016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.907583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:54.918247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1313/2625] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:54.922003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:54.932307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a141-ca81-4f50-89db-c7d074f238b2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.937063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed52b8-7a0b-417f-9514-0fcc7fce9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.937684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed52b8-7a0b-417f-9514-0fcc7fce9e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.937959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed52b8-7a0b-417f-9514-0fcc7fce9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.938228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed52b8-7a0b-417f-9514-0fcc7fce9e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.938867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed52b8-7a0b-417f-9514-0fcc7fce9e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.940722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed52b8-7a0b-417f-9514-0fcc7fce9e60 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:54.953691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1313/2626] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:54.958497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:54.968574 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1223-d9ed-4aba-a77d-c83ea47b2150 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:54.973657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:54.974292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:54.974567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:54.974837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] PATH_INFO: `/v3/projects/c3869df48f4345a4a32f974f21b9b970/users/3ae687c3af984f0c9551db0fdc085f88/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:54.989520 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3869df48f4345a4a32f974f21b9b970, user_id=3ae687c3af984f0c9551db0fdc085f88, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:54.992138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:55.004523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1314/2627] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:54 2022] PUT /identity/v3/projects/c3869df48f4345a4a32f974f21b9b970/users/3ae687c3af984f0c9551db0fdc085f88/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:04:55.016483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a5c4-e068-482f-b8cb-7689997e8467 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:55.016949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a5c4-e068-482f-b8cb-7689997e8467 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:55.017067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a5c4-e068-482f-b8cb-7689997e8467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:55.045844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6f30a5c4-e068-482f-b8cb-7689997e8467 None None] MFA Rules not processed for user `3ae687c3af984f0c9551db0fdc085f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:55.047064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6f30a5c4-e068-482f-b8cb-7689997e8467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:55.109848 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1314/2628] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:55.121178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:55.122840 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:55.180862 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc2fad-2fc8-40c6-9825-a8ab4f31cd57 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:55.184365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f016c-fe0c-4cfe-b60a-7cff29854eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:55.184952 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f016c-fe0c-4cfe-b60a-7cff29854eef service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:55.185262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f016c-fe0c-4cfe-b60a-7cff29854eef service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:55.185527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f016c-fe0c-4cfe-b60a-7cff29854eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:55.194134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f016c-fe0c-4cfe-b60a-7cff29854eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:55.195535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f016c-fe0c-4cfe-b60a-7cff29854eef service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:55.204087 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1315/2629] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:58.210230 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a5c4-e068-482f-b8cb-7689997e8467 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:58.215569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:58.278970 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30a5c4-e068-482f-b8cb-7689997e8467 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:58.283428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:58.284045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:58.284318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:58.284670 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] PATH_INFO: `/v3/users/3ae687c3af984f0c9551db0fdc085f88` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:58.286182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae687c3af984f0c9551db0fdc085f88)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:58.288066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:58.338568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae687c3af984f0c9551db0fdc085f88'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.346401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae687c3af984f0c9551db0fdc085f88'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.347851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae687c3af984f0c9551db0fdc085f88'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.360841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae687c3af984f0c9551db0fdc085f88'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.368210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae687c3af984f0c9551db0fdc085f88'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.374745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1315/2630] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:04:58 2022] DELETE /identity/v3/users/3ae687c3af984f0c9551db0fdc085f88 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:58.379875 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:58.380387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:58.380495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:58.399855 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:58.401066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:58.462319 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1316/2631] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:04:58.471903 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:58.473635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:58.531164 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4994-3fa5-4391-a6ef-762fba447c6d admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:58.534991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891689e1-c3b0-421a-817d-3fc33e84f7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:58.535594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891689e1-c3b0-421a-817d-3fc33e84f7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:58.535871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891689e1-c3b0-421a-817d-3fc33e84f7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:58.536141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891689e1-c3b0-421a-817d-3fc33e84f7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:58.544887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891689e1-c3b0-421a-817d-3fc33e84f7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:58.546337 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891689e1-c3b0-421a-817d-3fc33e84f7a8 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:58.555709 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1316/2632] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:04:58.821466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:58.823089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:58.837814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4d8ba-6999-4ffc-b25b-9f65e85d1d49 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:58.842757 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:58.843509 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:58.843857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:58.844279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] PATH_INFO: `/v3/projects/c3869df48f4345a4a32f974f21b9b970` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:58.845990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3869df48f4345a4a32f974f21b9b970)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:58.848697 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:58.866403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:58.898878 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3869df48f4345a4a32f974f21b9b970', 'request_id': 'req-7dc7fcf2-722a-490a-b821-b36aaef1860b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.906296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3869df48f4345a4a32f974f21b9b970', 'request_id': 'req-7dc7fcf2-722a-490a-b821-b36aaef1860b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.912165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3869df48f4345a4a32f974f21b9b970', 'request_id': 'req-7dc7fcf2-722a-490a-b821-b36aaef1860b'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.923443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] The token cache is being invalidate because project c3869df48f4345a4a32f974f21b9b970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:04:58.923736 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.924374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7dc7fcf2-722a-490a-b821-b36aaef1860b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:04:58.926632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1317/2633] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:04:58 2022] DELETE /identity/v3/projects/c3869df48f4345a4a32f974f21b9b970 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:58.931473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d486d0-b791-4722-8ef7-ef3008a9ea35 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:58.931756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d486d0-b791-4722-8ef7-ef3008a9ea35 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:58.932025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d486d0-b791-4722-8ef7-ef3008a9ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:58.951880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f6d486d0-b791-4722-8ef7-ef3008a9ea35 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:58.953059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f6d486d0-b791-4722-8ef7-ef3008a9ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:58.973583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:59.014225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1317/2634] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:59.022054 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067cd4-d734-4cb3-b090-37171fe3f50c None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.022341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067cd4-d734-4cb3-b090-37171fe3f50c None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.022619 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067cd4-d734-4cb3-b090-37171fe3f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.042495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f9067cd4-d734-4cb3-b090-37171fe3f50c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:59.043699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f9067cd4-d734-4cb3-b090-37171fe3f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:59.052069 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1318/2635] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:59.056187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d486d0-b791-4722-8ef7-ef3008a9ea35 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.065797 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d486d0-b791-4722-8ef7-ef3008a9ea35 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.070391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.070977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.071257 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.071529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.072170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:04:59.072470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.074119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.085587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1318/2636] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:04:59.089824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067cd4-d734-4cb3-b090-37171fe3f50c None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.099543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067cd4-d734-4cb3-b090-37171fe3f50c None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.104300 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.104884 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.105175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.105464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.106096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.107964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.137466 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1319/2637] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:59.141758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.151960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceba646-246b-4e60-87dd-d84ac5eea956 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.207983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.208579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.208857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.209127 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.209791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.211689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.233048 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1319/2638] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:59.237210 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.248201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f7003-d6b7-4645-86ac-61c8cf805ad6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.252802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.253554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.253834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.254111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.254750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.256356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.266204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1320/2639] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:59.269940 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.279820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e123d-20c3-475a-95b2-ac64fcd859aa admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.284347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1730193-a52b-44b9-9c31-45b0462a0694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.285504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730193-a52b-44b9-9c31-45b0462a0694 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.285820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730193-a52b-44b9-9c31-45b0462a0694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.286030 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730193-a52b-44b9-9c31-45b0462a0694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.286666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1730193-a52b-44b9-9c31-45b0462a0694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.288237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1730193-a52b-44b9-9c31-45b0462a0694 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.298476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1320/2640] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:59.303030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.312674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb9ff-6c61-4d44-83c1-920b0ae0b8ee admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.317358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.317992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.318271 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.318542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] PATH_INFO: `/v3/projects/dd87a2d29f6b49738e463e59d6075774/users/a3a1373b0a3a44bfb880f8a67a453742/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.333129 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd87a2d29f6b49738e463e59d6075774, user_id=a3a1373b0a3a44bfb880f8a67a453742, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.335928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.349105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1321/2641] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:59 2022] PUT /identity/v3/projects/dd87a2d29f6b49738e463e59d6075774/users/a3a1373b0a3a44bfb880f8a67a453742/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:04:59.359452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96f7c-2fd1-427f-b38e-244148d391a4 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.359762 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96f7c-2fd1-427f-b38e-244148d391a4 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.360034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96f7c-2fd1-427f-b38e-244148d391a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.388929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-1dd96f7c-2fd1-427f-b38e-244148d391a4 None None] MFA Rules not processed for user `a3a1373b0a3a44bfb880f8a67a453742`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:59.390194 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-1dd96f7c-2fd1-427f-b38e-244148d391a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:59.455847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1321/2642] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:59.459549 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.521893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9ec3e-bc12-42b8-8edf-5462d08fb71f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.526450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.527051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.527335 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.527604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.528228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.530157 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.556966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1322/2643] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:04:59.561208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd96f7c-2fd1-427f-b38e-244148d391a4 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.571924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd96f7c-2fd1-427f-b38e-244148d391a4 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.590816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:59.631024 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.631620 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.631893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.632157 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.632783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.634700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.656021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1322/2644] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:04:59.661120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.671361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4044bc-4976-4e36-af5d-1c16c07e6050 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.676580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.677244 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.677524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.677825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.678464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.680070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.690679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1323/2645] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:04:59.694938 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.704780 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af02cb9-029c-4f38-be7b-2b66e5290498 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.709981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7b240-7602-4bb4-93de-038ff3b58a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.710570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7b240-7602-4bb4-93de-038ff3b58a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.710850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7b240-7602-4bb4-93de-038ff3b58a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.711126 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7b240-7602-4bb4-93de-038ff3b58a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.711765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7b240-7602-4bb4-93de-038ff3b58a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.713374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7b240-7602-4bb4-93de-038ff3b58a12 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.723753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1323/2646] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:04:59.727782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.737490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8c29c-367b-4335-812e-12920ef6f320 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.742251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.743124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.743427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.743700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] PATH_INFO: `/v3/projects/3dcfbcb4b43f4c73bdfdc34c7f2828d1/users/4e542f9e63b244a99868df32f3c045f1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.755718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:59.760436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcfbcb4b43f4c73bdfdc34c7f2828d1, user_id=4e542f9e63b244a99868df32f3c045f1, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.763493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.777264 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1324/2647] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:04:59 2022] PUT /identity/v3/projects/3dcfbcb4b43f4c73bdfdc34c7f2828d1/users/4e542f9e63b244a99868df32f3c045f1/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:04:59.788280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0ad6-300c-436f-92ae-adc0e4e57206 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.788566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0ad6-300c-436f-92ae-adc0e4e57206 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.788844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0ad6-300c-436f-92ae-adc0e4e57206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.816876 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-648b0ad6-300c-436f-92ae-adc0e4e57206 None None] MFA Rules not processed for user `4e542f9e63b244a99868df32f3c045f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:04:59.818115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-648b0ad6-300c-436f-92ae-adc0e4e57206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:04:59.882349 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1324/2648] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:04:59.886838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:04:59.954871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdee03-9df8-4f73-83f5-24979887b88d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:04:59.961315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:04:59.961983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:04:59.962261 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:04:59.962529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:04:59.963163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:04:59.965046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:04:59.991890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1325/2649] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:04:59.996190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0ad6-300c-436f-92ae-adc0e4e57206 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:00.007717 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0ad6-300c-436f-92ae-adc0e4e57206 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:00.069180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:00.069801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.070080 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.070352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.070995 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:00.072923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:00.097004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1325/2650] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:04:59 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:00.101070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:00.111397 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9b0ac-3039-4625-acd0-13333e675806 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:00.117420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:00.118103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.118445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.118774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.119476 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:00.121379 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:00.133134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1326/2651] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:00.137470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:00.147782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0443cb-69a1-47b7-acdd-f237a0344532 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:00.152432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:00.153087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.153396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.153671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] PATH_INFO: `/v3/projects/e8192e876d604d9da5faedaca39eb148/users/8f2200163733477f93ff467da3535c60/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.169015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8192e876d604d9da5faedaca39eb148, user_id=8f2200163733477f93ff467da3535c60, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:00.171851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:00.174976 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:00.186842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1326/2652] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:00 2022] PUT /identity/v3/projects/e8192e876d604d9da5faedaca39eb148/users/8f2200163733477f93ff467da3535c60/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:05:00.192241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:00.202327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165c05-b17c-48a0-88f2-185853031752 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:00.260289 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68764e1f-f21b-4e89-85f1-782ef8bb61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:00.260907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68764e1f-f21b-4e89-85f1-782ef8bb61b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.261213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68764e1f-f21b-4e89-85f1-782ef8bb61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.261492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68764e1f-f21b-4e89-85f1-782ef8bb61b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.262140 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68764e1f-f21b-4e89-85f1-782ef8bb61b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:00.263711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68764e1f-f21b-4e89-85f1-782ef8bb61b3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:00.273675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1327/2653] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:00.278160 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:00.289302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763c307-437b-41b7-b3d3-472db39a7133 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:00.293862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:00.294509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.294795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.295064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] PATH_INFO: `/v3/projects/e8192e876d604d9da5faedaca39eb148/users/8f2200163733477f93ff467da3535c60/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.296942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8192e876d604d9da5faedaca39eb148, user_id=8f2200163733477f93ff467da3535c60, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:00.299564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:00.314109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1327/2654] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:00 2022] PUT /identity/v3/projects/e8192e876d604d9da5faedaca39eb148/users/8f2200163733477f93ff467da3535c60/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:00.325024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.325363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.325643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.353646 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] MFA Rules not processed for user `8f2200163733477f93ff467da3535c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:00.354869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:00.403403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:00.426704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1328/2655] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:00.438470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:00.440214 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:00.502731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbfbb5-25a6-41ae-90d7-2dd1da40dce6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:00.507216 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:00.507843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:00.508119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:00.508391 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:00.574669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:00.576601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:00.589049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1328/2656] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:02.120372 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:02.121841 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:02.134086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad3a60-b861-4b5e-92b2-5db04d028f8b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:02.137645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:02.138234 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:02.138510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:02.138779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:02.194729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:02.196076 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:02.204869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1329/2657] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:02.733786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:02.742347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996668bb-1848-4926-894d-084ec0282882 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:02.746239 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08a1d2-1357-4295-b5b5-e907797c482d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:02.746832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08a1d2-1357-4295-b5b5-e907797c482d service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:02.747113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08a1d2-1357-4295-b5b5-e907797c482d service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:02.747386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08a1d2-1357-4295-b5b5-e907797c482d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:02.757631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08a1d2-1357-4295-b5b5-e907797c482d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:02.759063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08a1d2-1357-4295-b5b5-e907797c482d service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:02.768763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1329/2658] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:06.654421 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:06.721803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea113fa-f1e2-4606-964d-f036de538c35 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:06.727023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:06.727648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:06.727924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:06.728188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] PATH_INFO: `/v3/users/a3a1373b0a3a44bfb880f8a67a453742` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:06.729325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a1373b0a3a44bfb880f8a67a453742)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:06.731331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:06.780893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a1373b0a3a44bfb880f8a67a453742'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:06.793270 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a1373b0a3a44bfb880f8a67a453742'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:06.800571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a1373b0a3a44bfb880f8a67a453742'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:06.801205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a1373b0a3a44bfb880f8a67a453742'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:06.808407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a1373b0a3a44bfb880f8a67a453742'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:06.814904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1330/2659] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:06 2022] DELETE /identity/v3/users/a3a1373b0a3a44bfb880f8a67a453742 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:06.820057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:06.820563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:06.820684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:06.839983 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:06.841208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:06.902969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1330/2660] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:06.912966 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:06.914468 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:06.919918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:06.976700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6853267-c1d5-401c-8c35-1da2b2155870 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:06.980383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:06.980986 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:06.981301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:06.981573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:06.994640 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:06.996456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:07.008104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1331/2661] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:07.340091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:07.341599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:07.369524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3698-ac2d-48bc-9e63-cab3ce15c38e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:07.385392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:07.386307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:07.386677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:07.387010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] PATH_INFO: `/v3/projects/dd87a2d29f6b49738e463e59d6075774` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:07.388224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd87a2d29f6b49738e463e59d6075774)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:07.390247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:07.424193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:07.475881 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd87a2d29f6b49738e463e59d6075774', 'request_id': 'req-d6c4fab2-a3ba-4951-aed1-028774f62c8c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.495657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd87a2d29f6b49738e463e59d6075774', 'request_id': 'req-d6c4fab2-a3ba-4951-aed1-028774f62c8c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.502243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd87a2d29f6b49738e463e59d6075774', 'request_id': 'req-d6c4fab2-a3ba-4951-aed1-028774f62c8c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.515595 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] The token cache is being invalidate because project dd87a2d29f6b49738e463e59d6075774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:07.515973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.516697 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.518296 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1331/2662] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:07 2022] DELETE /identity/v3/projects/dd87a2d29f6b49738e463e59d6075774 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:07.523022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:07.534537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132006-6675-43ec-a98d-dd845e9682d2 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:07.617049 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:07.617970 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:07.618250 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:07.618523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] PATH_INFO: `/v3/users/4e542f9e63b244a99868df32f3c045f1` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:07.620012 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e542f9e63b244a99868df32f3c045f1)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:07.621979 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:07.801276 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e542f9e63b244a99868df32f3c045f1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.814732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e542f9e63b244a99868df32f3c045f1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.824339 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e542f9e63b244a99868df32f3c045f1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.825096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e542f9e63b244a99868df32f3c045f1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.834536 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e542f9e63b244a99868df32f3c045f1'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:07.841326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1332/2663] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:07 2022] DELETE /identity/v3/users/4e542f9e63b244a99868df32f3c045f1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:08.150111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:08.151734 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:08.182110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fab2-a3ba-4951-aed1-028774f62c8c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:08.390280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:08.391050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:08.391389 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:08.391724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] PATH_INFO: `/v3/projects/3dcfbcb4b43f4c73bdfdc34c7f2828d1` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:08.392969 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcfbcb4b43f4c73bdfdc34c7f2828d1)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:08.395050 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:08.458567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcfbcb4b43f4c73bdfdc34c7f2828d1', 'request_id': 'req-d013f32b-2984-472a-9ad8-7297f37ccb87'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.470103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcfbcb4b43f4c73bdfdc34c7f2828d1', 'request_id': 'req-d013f32b-2984-472a-9ad8-7297f37ccb87'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.479255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcfbcb4b43f4c73bdfdc34c7f2828d1', 'request_id': 'req-d013f32b-2984-472a-9ad8-7297f37ccb87'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.491682 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] The token cache is being invalidate because project 3dcfbcb4b43f4c73bdfdc34c7f2828d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:08.491972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.492641 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.494183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1332/2664] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:08 2022] DELETE /identity/v3/projects/3dcfbcb4b43f4c73bdfdc34c7f2828d1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:08.498676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:08.500133 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:08.512797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c99de-b09e-4a6e-994c-5481c5beccbb admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:08.535827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:08.581630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:08.582881 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:08.583122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:08.583439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] PATH_INFO: `/v3/users/8f2200163733477f93ff467da3535c60` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:08.585719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2200163733477f93ff467da3535c60)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:08.587748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:08.643209 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2200163733477f93ff467da3535c60'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.661455 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2200163733477f93ff467da3535c60'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.670356 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2200163733477f93ff467da3535c60'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.670992 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2200163733477f93ff467da3535c60'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.678489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2200163733477f93ff467da3535c60'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:08.685005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1333/2665] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:08 2022] DELETE /identity/v3/users/8f2200163733477f93ff467da3535c60 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:08.970927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:08.972519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:08.987096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013f32b-2984-472a-9ad8-7297f37ccb87 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:09.026630 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:09.053136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:09.053793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:09.054073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:09.054344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] PATH_INFO: `/v3/projects/e8192e876d604d9da5faedaca39eb148` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:09.055470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8192e876d604d9da5faedaca39eb148)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:09.057533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:09.103603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8192e876d604d9da5faedaca39eb148', 'request_id': 'req-b2971767-521c-467c-bcb2-076d31b4c2bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:09.111199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8192e876d604d9da5faedaca39eb148', 'request_id': 'req-b2971767-521c-467c-bcb2-076d31b4c2bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:09.117466 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8192e876d604d9da5faedaca39eb148', 'request_id': 'req-b2971767-521c-467c-bcb2-076d31b4c2bd'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:09.128777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] The token cache is being invalidate because project e8192e876d604d9da5faedaca39eb148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:09.129122 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:09.129963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:09.131733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1333/2666] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:08 2022] DELETE /identity/v3/projects/e8192e876d604d9da5faedaca39eb148 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:11.345634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:11.347017 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:11.403096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d83854-8384-4723-9eec-b31bbf1a9c2e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:11.451328 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:11.451922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:11.452195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:11.452458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:11.454331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:11.467216 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:11.521770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:11.523275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:11.532852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1334/2667] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:14.472090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:14.476262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:14.489428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2971767-521c-467c-bcb2-076d31b4c2bd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:14.494748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:14.495647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:14.495926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:14.496195 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] PATH_INFO: `/v3/users/092e7d9f6d0f4c6984785e05162483ed` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:14.497339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] RBAC: Authorizing `identity:delete_user(user_id=092e7d9f6d0f4c6984785e05162483ed)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:14.499233 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:14.553182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092e7d9f6d0f4c6984785e05162483ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.561298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092e7d9f6d0f4c6984785e05162483ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.561928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092e7d9f6d0f4c6984785e05162483ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.575015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092e7d9f6d0f4c6984785e05162483ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.582114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6ab226bb-f2e3-4cf8-86b6-412c4c4d107f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092e7d9f6d0f4c6984785e05162483ed'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.589279 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1334/2668] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:14 2022] DELETE /identity/v3/users/092e7d9f6d0f4c6984785e05162483ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:14.760072 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:14.770337 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a054-9cec-4c78-bc7c-34f747aba300 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:14.826384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:14.827006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:14.827282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:14.827551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] PATH_INFO: `/v3/projects/a6fd6d54dfcb44f6a1546d9c011dbada` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:14.828643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fd6d54dfcb44f6a1546d9c011dbada)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:14.830585 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:14.877451 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fd6d54dfcb44f6a1546d9c011dbada', 'request_id': 'req-35e14aac-387e-4ceb-bfa7-5c1043f71c10'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.884796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fd6d54dfcb44f6a1546d9c011dbada', 'request_id': 'req-35e14aac-387e-4ceb-bfa7-5c1043f71c10'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.890413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fd6d54dfcb44f6a1546d9c011dbada', 'request_id': 'req-35e14aac-387e-4ceb-bfa7-5c1043f71c10'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.901418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] The token cache is being invalidate because project a6fd6d54dfcb44f6a1546d9c011dbada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:14.901705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.902333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-35e14aac-387e-4ceb-bfa7-5c1043f71c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:14.903789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1335/2669] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:14 2022] DELETE /identity/v3/projects/a6fd6d54dfcb44f6a1546d9c011dbada => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:14.908629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d35aa3-b9b0-4990-8a97-a768214028fe None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:14.908914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d35aa3-b9b0-4990-8a97-a768214028fe None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:14.909210 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d35aa3-b9b0-4990-8a97-a768214028fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:14.929494 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b6d35aa3-b9b0-4990-8a97-a768214028fe None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:14.930680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b6d35aa3-b9b0-4990-8a97-a768214028fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:14.965207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:14.993171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1335/2670] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:15.001353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cebdc6-59c9-4410-ac4a-89eab88749cb None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.001637 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cebdc6-59c9-4410-ac4a-89eab88749cb None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.001910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cebdc6-59c9-4410-ac4a-89eab88749cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.021296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-79cebdc6-59c9-4410-ac4a-89eab88749cb None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:15.022657 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-79cebdc6-59c9-4410-ac4a-89eab88749cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:15.030447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1336/2671] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:15.034546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d35aa3-b9b0-4990-8a97-a768214028fe None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.044802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d35aa3-b9b0-4990-8a97-a768214028fe None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.049532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.050130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.050434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.050704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.051348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:05:15.051647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.053438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.065373 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1336/2672] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:05:15.069602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cebdc6-59c9-4410-ac4a-89eab88749cb None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.078609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cebdc6-59c9-4410-ac4a-89eab88749cb None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.083312 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.084380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.084666 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.084920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.085573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.087450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.114984 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1337/2673] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:15 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:15.119568 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.129532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360452-989b-4397-a89d-535a89d3f511 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.186247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.186766 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.187047 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.187320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.187958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.189994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.211678 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1337/2674] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:15 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:05:15.215819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.226738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd4f1-1461-43ed-8e1e-20397ff63600 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.231187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.231769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.232041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.232303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.233035 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.234658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.239737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:15.246480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1338/2675] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:15.249341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.259304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1902-893b-42f3-874f-42fc4a5cf9d1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.263751 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446b38-2ab1-4e62-9fae-9560a7a1257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.264347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446b38-2ab1-4e62-9fae-9560a7a1257a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.264602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446b38-2ab1-4e62-9fae-9560a7a1257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.264867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446b38-2ab1-4e62-9fae-9560a7a1257a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.265546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446b38-2ab1-4e62-9fae-9560a7a1257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.267090 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446b38-2ab1-4e62-9fae-9560a7a1257a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.277539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1338/2676] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:15.281684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.292391 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b024a-c297-48b6-921f-37466646ebe5 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.296927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.297604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.297883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.298152 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] PATH_INFO: `/v3/projects/9b0437e0cecc41ce838c7bab93ce0f91/users/f08b16ff0f694d94a255853bc64c22d5/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.313577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0437e0cecc41ce838c7bab93ce0f91, user_id=f08b16ff0f694d94a255853bc64c22d5, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.316172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.328596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1339/2677] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:15 2022] PUT /identity/v3/projects/9b0437e0cecc41ce838c7bab93ce0f91/users/f08b16ff0f694d94a255853bc64c22d5/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:05:15.339666 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e813c82-46cd-4643-be3f-6dd35b2f134b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.339980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e813c82-46cd-4643-be3f-6dd35b2f134b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.340258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e813c82-46cd-4643-be3f-6dd35b2f134b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.368155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-4e813c82-46cd-4643-be3f-6dd35b2f134b None None] MFA Rules not processed for user `f08b16ff0f694d94a255853bc64c22d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:15.369388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-4e813c82-46cd-4643-be3f-6dd35b2f134b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:15.432941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1339/2678] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:05:15.437470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.503191 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59225-dc07-4466-90c8-0107e81154c8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.508600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.509228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.509513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.509784 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.510424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.512302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.541642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1340/2679] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:15 2022] POST /identity/v3/projects => generated 361 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:05:15.545645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e813c82-46cd-4643-be3f-6dd35b2f134b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.556485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e813c82-46cd-4643-be3f-6dd35b2f134b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.588986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:15.613327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.613919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.614197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.614462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.615305 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.617324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.638835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1340/2680] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:15 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:15.642912 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.654009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eb6a5-6ae9-4db3-81fe-f87f370bf8e2 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.658846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.659586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.659865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.660138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.661018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.662425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.672996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1341/2681] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:15.677087 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.687097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7d89-a93d-4c25-b63e-c959f7c2e300 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.691599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.692178 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.692451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.692713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] PATH_INFO: `/v3/projects/dd3fe8df165c489ba3985f27e39a3883/users/c70a759e20924dc6bae13aac31331ac9/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.708036 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3fe8df165c489ba3985f27e39a3883, user_id=c70a759e20924dc6bae13aac31331ac9, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.711374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.724158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1341/2682] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:15 2022] PUT /identity/v3/projects/dd3fe8df165c489ba3985f27e39a3883/users/c70a759e20924dc6bae13aac31331ac9/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:15.728256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.737980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e661b8-cdd3-4519-a794-22e2511430e0 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.793531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c646a2-9fe2-48af-818b-543c3215f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.794175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c646a2-9fe2-48af-818b-543c3215f20e admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.794385 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c646a2-9fe2-48af-818b-543c3215f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.794652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c646a2-9fe2-48af-818b-543c3215f20e admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.795284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c646a2-9fe2-48af-818b-543c3215f20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.796842 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c646a2-9fe2-48af-818b-543c3215f20e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.806237 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1342/2683] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:15.810388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.820874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2b7a-73ff-4a86-878e-e5df93c1b6c5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:15.825445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:15.826074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.826348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.826613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] PATH_INFO: `/v3/projects/dd3fe8df165c489ba3985f27e39a3883/users/c70a759e20924dc6bae13aac31331ac9/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.828477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3fe8df165c489ba3985f27e39a3883, user_id=c70a759e20924dc6bae13aac31331ac9, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:15.831105 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:15.841465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1342/2684] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:15 2022] PUT /identity/v3/projects/dd3fe8df165c489ba3985f27e39a3883/users/c70a759e20924dc6bae13aac31331ac9/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:15.852980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2666-e862-4645-90b6-8f437b7ad747 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:15.853294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2666-e862-4645-90b6-8f437b7ad747 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:15.853568 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2666-e862-4645-90b6-8f437b7ad747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:15.882170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-221b2666-e862-4645-90b6-8f437b7ad747 None None] MFA Rules not processed for user `c70a759e20924dc6bae13aac31331ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:15.883368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-221b2666-e862-4645-90b6-8f437b7ad747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:15.916365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:15.953079 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1343/2685] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:15.964882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:15.967246 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:16.023357 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46f40e-5b44-485d-a8bb-73e6d001b850 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:16.026980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e379ec-305c-4094-85d5-c1706fbd270c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:16.027564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e379ec-305c-4094-85d5-c1706fbd270c service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:16.027839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e379ec-305c-4094-85d5-c1706fbd270c service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:16.028112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e379ec-305c-4094-85d5-c1706fbd270c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:16.036935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e379ec-305c-4094-85d5-c1706fbd270c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:16.038369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e379ec-305c-4094-85d5-c1706fbd270c service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:16.047431 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1343/2686] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:16.463741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b2666-e862-4645-90b6-8f437b7ad747 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:16.524308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b2666-e862-4645-90b6-8f437b7ad747 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:16.528720 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:16.529348 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:16.529635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:16.529888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] PATH_INFO: `/v3/users/f08b16ff0f694d94a255853bc64c22d5` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:16.530982 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08b16ff0f694d94a255853bc64c22d5)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:16.532891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:16.578407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08b16ff0f694d94a255853bc64c22d5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:16.590795 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08b16ff0f694d94a255853bc64c22d5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:16.598142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08b16ff0f694d94a255853bc64c22d5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:16.598770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08b16ff0f694d94a255853bc64c22d5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:16.606005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08b16ff0f694d94a255853bc64c22d5'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:16.611856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1344/2687] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:16 2022] DELETE /identity/v3/users/f08b16ff0f694d94a255853bc64c22d5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:16.617038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:16.617556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:16.617672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:16.636536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:16.637741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:16.702025 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1344/2688] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:16.711869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:16.713326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:16.769429 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1748d37-6ea1-42c6-b72f-235a382087e7 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:16.773253 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:16.773845 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:16.774120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:16.774389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:16.780118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:16.784896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:16.786662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:16.797105 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1345/2689] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:17.062429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:17.063862 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:17.075704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efc16c-856b-4550-9028-65c4936e1944 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:17.080387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:17.081045 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:17.081362 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:17.081632 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] PATH_INFO: `/v3/projects/9b0437e0cecc41ce838c7bab93ce0f91` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:17.082746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0437e0cecc41ce838c7bab93ce0f91)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:17.084667 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:17.116980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:17.135007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0437e0cecc41ce838c7bab93ce0f91', 'request_id': 'req-a199454e-6167-4b46-8031-464076ef6a11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.141897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0437e0cecc41ce838c7bab93ce0f91', 'request_id': 'req-a199454e-6167-4b46-8031-464076ef6a11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.147611 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0437e0cecc41ce838c7bab93ce0f91', 'request_id': 'req-a199454e-6167-4b46-8031-464076ef6a11'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.158452 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] The token cache is being invalidate because project 9b0437e0cecc41ce838c7bab93ce0f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:17.158743 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.159377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.160909 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1345/2690] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:17 2022] DELETE /identity/v3/projects/9b0437e0cecc41ce838c7bab93ce0f91 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:17.165936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:17.175814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40091a6-ee27-4a39-82b6-b3572a9767c1 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:17.231647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:17.232263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:17.232547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:17.232820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] PATH_INFO: `/v3/users/c70a759e20924dc6bae13aac31331ac9` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:17.234028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70a759e20924dc6bae13aac31331ac9)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:17.235856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:17.280519 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70a759e20924dc6bae13aac31331ac9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.292950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70a759e20924dc6bae13aac31331ac9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.299686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70a759e20924dc6bae13aac31331ac9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.300361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70a759e20924dc6bae13aac31331ac9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.307920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-0c7647c8-01c4-4966-8371-5308d39db040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70a759e20924dc6bae13aac31331ac9'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.313711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1346/2691] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:17 2022] DELETE /identity/v3/users/c70a759e20924dc6bae13aac31331ac9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:17.577754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:17.579322 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:17.593722 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199454e-6167-4b46-8031-464076ef6a11 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:17.649752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:17.650382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:17.650644 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:17.650918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] PATH_INFO: `/v3/projects/dd3fe8df165c489ba3985f27e39a3883` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:17.652059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3fe8df165c489ba3985f27e39a3883)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:17.653981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:17.700476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3fe8df165c489ba3985f27e39a3883', 'request_id': 'req-420e6a1c-92f3-4dda-b87d-19c346bb9ead'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.707517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3fe8df165c489ba3985f27e39a3883', 'request_id': 'req-420e6a1c-92f3-4dda-b87d-19c346bb9ead'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.713770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3fe8df165c489ba3985f27e39a3883', 'request_id': 'req-420e6a1c-92f3-4dda-b87d-19c346bb9ead'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.724426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] The token cache is being invalidate because project dd3fe8df165c489ba3985f27e39a3883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:17.724712 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.725363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-420e6a1c-92f3-4dda-b87d-19c346bb9ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:17.726910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1346/2692] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:17 2022] DELETE /identity/v3/projects/dd3fe8df165c489ba3985f27e39a3883 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:17.732067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d057f68-3cad-43a4-b7bc-1981ebee0716 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:17.732360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d057f68-3cad-43a4-b7bc-1981ebee0716 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:17.732632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d057f68-3cad-43a4-b7bc-1981ebee0716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:17.752030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6d057f68-3cad-43a4-b7bc-1981ebee0716 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:17.753265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6d057f68-3cad-43a4-b7bc-1981ebee0716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:17.812773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1347/2693] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:17.820764 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35330a-e99e-49c2-9660-8d2fa21bcefa None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:17.821039 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35330a-e99e-49c2-9660-8d2fa21bcefa None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:17.821350 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35330a-e99e-49c2-9660-8d2fa21bcefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:17.841091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-6e35330a-e99e-49c2-9660-8d2fa21bcefa None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:17.842326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6e35330a-e99e-49c2-9660-8d2fa21bcefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:17.850267 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1347/2694] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:17.855045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d057f68-3cad-43a4-b7bc-1981ebee0716 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:17.864541 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d057f68-3cad-43a4-b7bc-1981ebee0716 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:17.869403 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:17.870241 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:17.870556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:17.870821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:17.871458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:05:17.871747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:17.873655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:17.882498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:17.886282 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1348/2695] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:05:17.890575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35330a-e99e-49c2-9660-8d2fa21bcefa None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:17.900423 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35330a-e99e-49c2-9660-8d2fa21bcefa None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:17.905255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:17.905842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:17.906115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:17.906380 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:17.907009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:17.908859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:17.934926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1348/2696] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:17 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:17.939202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:17.949495 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b08e8-9ff3-4014-aafa-4311fc5ffa11 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.005498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.006097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.006374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.006643 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.007772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.009835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.030937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1349/2697] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:17 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:18.035206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.045563 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca04c4e-2a47-45bd-a3c2-8e383e15f4fe admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.050168 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.050738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.051017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.051320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.051958 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.053578 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.063826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1349/2698] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:18.067693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.078317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efc664-405e-4a16-b260-11eaee9c1bc0 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.083147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14717f-7464-4ac4-be97-75e74d002fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.083739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14717f-7464-4ac4-be97-75e74d002fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.084018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14717f-7464-4ac4-be97-75e74d002fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.084290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14717f-7464-4ac4-be97-75e74d002fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.084937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14717f-7464-4ac4-be97-75e74d002fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.086563 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14717f-7464-4ac4-be97-75e74d002fbb admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.096946 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1350/2699] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:18.100824 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.106963 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:18.111099 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11603f-fed7-4553-836d-8795212f6701 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.118020 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.118917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.119428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.119883 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] PATH_INFO: `/v3/projects/e1d004955da14591822a11d06ac88065/users/e146823ebacc4f9c97fcec9f3fcd5cbe/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.136128 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d004955da14591822a11d06ac88065, user_id=e146823ebacc4f9c97fcec9f3fcd5cbe, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.138826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.151244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1350/2700] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:18 2022] PUT /identity/v3/projects/e1d004955da14591822a11d06ac88065/users/e146823ebacc4f9c97fcec9f3fcd5cbe/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:18.161670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8167-3e77-4759-adb7-ae23e2b80c15 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.162019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8167-3e77-4759-adb7-ae23e2b80c15 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.162259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8167-3e77-4759-adb7-ae23e2b80c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.189745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-731f8167-3e77-4759-adb7-ae23e2b80c15 None None] MFA Rules not processed for user `e146823ebacc4f9c97fcec9f3fcd5cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:18.190945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-731f8167-3e77-4759-adb7-ae23e2b80c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:18.253773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1351/2701] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:18.258964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.321133 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e9e41-6a91-47cc-b819-34a360bcea13 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.325723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.326310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.326588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.326860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.327490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.329396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.354564 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1351/2702] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:18 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:05:18.358673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f8167-3e77-4759-adb7-ae23e2b80c15 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.369760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f8167-3e77-4759-adb7-ae23e2b80c15 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.425082 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.425701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.425977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.426248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.426869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.428734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.445604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:18.452445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1352/2703] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:18 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:18.456477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.466818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db576-7b4e-4516-9625-c3fcdcc1aa19 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.472011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.472599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.472902 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.473205 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.473847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.475453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.486186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1352/2704] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:18.490436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.501224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70585fb7-1cd6-4980-8b77-b9264859aaf8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.505825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.506470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.506747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.507022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] PATH_INFO: `/v3/projects/e71bb1bbe5824bb3947e3cf2103f8108/users/ed6849cf2ade430a83c0acd8138b1379/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.521570 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71bb1bbe5824bb3947e3cf2103f8108, user_id=ed6849cf2ade430a83c0acd8138b1379, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.524186 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.536756 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1353/2705] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:18 2022] PUT /identity/v3/projects/e71bb1bbe5824bb3947e3cf2103f8108/users/ed6849cf2ade430a83c0acd8138b1379/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:18.541392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.551029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12217-06f8-47fd-beb4-add65d4f8dc3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.606115 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b23c1-4225-47b5-bb43-039f673bf265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.606637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b23c1-4225-47b5-bb43-039f673bf265 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.606914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b23c1-4225-47b5-bb43-039f673bf265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.607184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b23c1-4225-47b5-bb43-039f673bf265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.607814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b23c1-4225-47b5-bb43-039f673bf265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.609422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b23c1-4225-47b5-bb43-039f673bf265 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.618816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1353/2706] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:18.623431 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.634242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb175-d302-49d6-afcf-a30ff4224c77 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.638853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.639490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.639769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.640042 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] PATH_INFO: `/v3/projects/e71bb1bbe5824bb3947e3cf2103f8108/users/ed6849cf2ade430a83c0acd8138b1379/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.641996 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71bb1bbe5824bb3947e3cf2103f8108, user_id=ed6849cf2ade430a83c0acd8138b1379, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.644594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.655814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1354/2707] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:18 2022] PUT /identity/v3/projects/e71bb1bbe5824bb3947e3cf2103f8108/users/ed6849cf2ade430a83c0acd8138b1379/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:18.667038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb44fe-58d7-4356-b112-d22b24903e21 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.667468 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb44fe-58d7-4356-b112-d22b24903e21 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.667605 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb44fe-58d7-4356-b112-d22b24903e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.695336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-affb44fe-58d7-4356-b112-d22b24903e21 None None] MFA Rules not processed for user `ed6849cf2ade430a83c0acd8138b1379`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:18.696636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-affb44fe-58d7-4356-b112-d22b24903e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:18.737278 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:18.767208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1354/2708] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:18.778653 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:18.780353 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:18.837636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66afe18-0a86-4f29-b2be-6ce7b4f79772 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:18.841285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b833ef2-2db8-48a7-8171-1494376b90e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:18.841867 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833ef2-2db8-48a7-8171-1494376b90e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:18.842138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833ef2-2db8-48a7-8171-1494376b90e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:18.842401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b833ef2-2db8-48a7-8171-1494376b90e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:18.851424 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b833ef2-2db8-48a7-8171-1494376b90e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:18.852827 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b833ef2-2db8-48a7-8171-1494376b90e0 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:18.862117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1355/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:20.196153 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb44fe-58d7-4356-b112-d22b24903e21 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:20.256980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb44fe-58d7-4356-b112-d22b24903e21 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:20.261913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:20.262550 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:20.262828 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:20.263102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] PATH_INFO: `/v3/users/e146823ebacc4f9c97fcec9f3fcd5cbe` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:20.264269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e146823ebacc4f9c97fcec9f3fcd5cbe)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:20.266242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:20.312636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e146823ebacc4f9c97fcec9f3fcd5cbe'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.319972 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e146823ebacc4f9c97fcec9f3fcd5cbe'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.320746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e146823ebacc4f9c97fcec9f3fcd5cbe'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.332285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e146823ebacc4f9c97fcec9f3fcd5cbe'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.339727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e146823ebacc4f9c97fcec9f3fcd5cbe'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.345446 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1355/2710] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:20 2022] DELETE /identity/v3/users/e146823ebacc4f9c97fcec9f3fcd5cbe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:20.349831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:20.350294 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:20.350411 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:20.369595 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:20.371043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:20.432834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1356/2711] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:20.439339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:20.440760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:20.503176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec438a9-e948-4c94-98fa-f7a11db8b9e1 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:20.507004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:20.507613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:20.507889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:20.508154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:20.520892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:20.522500 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:20.527095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:20.534616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1356/2712] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:20.833109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:20.834540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:20.847185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05669c-df50-4ec6-9863-6d079eb437e3 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:20.852597 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:20.853290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:20.853564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:20.853831 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] PATH_INFO: `/v3/projects/e1d004955da14591822a11d06ac88065` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:20.854942 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d004955da14591822a11d06ac88065)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:20.856962 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:20.905102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d004955da14591822a11d06ac88065', 'request_id': 'req-a452661e-d39d-425d-b177-e9ca19ffae9f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.912202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d004955da14591822a11d06ac88065', 'request_id': 'req-a452661e-d39d-425d-b177-e9ca19ffae9f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.915013 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:20.919601 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d004955da14591822a11d06ac88065', 'request_id': 'req-a452661e-d39d-425d-b177-e9ca19ffae9f'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.932559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] The token cache is being invalidate because project e1d004955da14591822a11d06ac88065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:20.932843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.933505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:20.935020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1357/2713] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:20 2022] DELETE /identity/v3/projects/e1d004955da14591822a11d06ac88065 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:20.939140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:20.949234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709578e-4857-4bf3-9643-15f73601a323 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:21.012465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:21.013086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:21.013397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:21.013669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] PATH_INFO: `/v3/users/ed6849cf2ade430a83c0acd8138b1379` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:21.014783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6849cf2ade430a83c0acd8138b1379)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:21.016680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:21.062223 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6849cf2ade430a83c0acd8138b1379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.069034 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6849cf2ade430a83c0acd8138b1379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.069843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6849cf2ade430a83c0acd8138b1379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.082608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6849cf2ade430a83c0acd8138b1379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.090490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-65283835-c7db-4daa-82d1-63903b507632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6849cf2ade430a83c0acd8138b1379'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.096920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1357/2714] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:20 2022] DELETE /identity/v3/users/ed6849cf2ade430a83c0acd8138b1379 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:21.644001 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:21.645498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:21.664445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452661e-d39d-425d-b177-e9ca19ffae9f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:21.732776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:21.733477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:21.733753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:21.734142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] PATH_INFO: `/v3/projects/e71bb1bbe5824bb3947e3cf2103f8108` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:21.735384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71bb1bbe5824bb3947e3cf2103f8108)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:21.737604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:21.790090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71bb1bbe5824bb3947e3cf2103f8108', 'request_id': 'req-73804e99-2447-4613-9efe-2aa09b17312d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.797748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71bb1bbe5824bb3947e3cf2103f8108', 'request_id': 'req-73804e99-2447-4613-9efe-2aa09b17312d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.803628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71bb1bbe5824bb3947e3cf2103f8108', 'request_id': 'req-73804e99-2447-4613-9efe-2aa09b17312d'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.817326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] The token cache is being invalidate because project e71bb1bbe5824bb3947e3cf2103f8108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:21.817539 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.818171 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-73804e99-2447-4613-9efe-2aa09b17312d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:21.820436 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1358/2715] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:21 2022] DELETE /identity/v3/projects/e71bb1bbe5824bb3947e3cf2103f8108 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:05:21.826776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078b1a-0003-4f26-a419-4be4c096189b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:21.827741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078b1a-0003-4f26-a419-4be4c096189b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:21.827741 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078b1a-0003-4f26-a419-4be4c096189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:21.862113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-52078b1a-0003-4f26-a419-4be4c096189b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:21.863338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-52078b1a-0003-4f26-a419-4be4c096189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:21.932880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1358/2716] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:21.941326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f287-eee0-4f59-af37-3ee42a1c259e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:21.941626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f287-eee0-4f59-af37-3ee42a1c259e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:21.941874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f287-eee0-4f59-af37-3ee42a1c259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:21.963924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1f98f287-eee0-4f59-af37-3ee42a1c259e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:21.965787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1f98f287-eee0-4f59-af37-3ee42a1c259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:21.974029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1359/2717] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:21.978626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078b1a-0003-4f26-a419-4be4c096189b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:21.988584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078b1a-0003-4f26-a419-4be4c096189b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:21.994649 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:21.995501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:21.995776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:21.996043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:21.996695 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:05:21.996989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:21.998602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.012822 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1359/2718] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:05:22.017516 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f287-eee0-4f59-af37-3ee42a1c259e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.027224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f287-eee0-4f59-af37-3ee42a1c259e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.032287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.032880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.033164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.033453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.034288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.036148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.065068 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1360/2719] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:22 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:05:22.071327 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.077596 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:22.082145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb531-0148-4d4e-b674-7def27e7ba05 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.152971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.153606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.153879 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.154148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.154789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.156873 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.180602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1360/2720] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:22 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:22.185267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.198080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17830277-820b-45c6-b044-7ecf0c984671 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.203117 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.203723 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.204007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.204279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.204920 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.206537 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.217464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1361/2721] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:22.221533 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.232716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154b591-7f86-46fb-8f8e-3a50b4767334 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.237830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63edb43-f9c9-480c-854e-89247a206891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.238432 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edb43-f9c9-480c-854e-89247a206891 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.238711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edb43-f9c9-480c-854e-89247a206891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.238981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edb43-f9c9-480c-854e-89247a206891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.239662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63edb43-f9c9-480c-854e-89247a206891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.241304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63edb43-f9c9-480c-854e-89247a206891 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.254346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1361/2722] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:22.258709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.269671 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7bdae-266e-4491-9ad6-a5b54388ada3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.274459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.275118 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.275371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.275641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] PATH_INFO: `/v3/projects/8663b30d418c4f5cb261759ab2efb33b/users/ee0dba644ddf40628e05534d5362eff0/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.296215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8663b30d418c4f5cb261759ab2efb33b, user_id=ee0dba644ddf40628e05534d5362eff0, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.301177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.318866 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1362/2723] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:22 2022] PUT /identity/v3/projects/8663b30d418c4f5cb261759ab2efb33b/users/ee0dba644ddf40628e05534d5362eff0/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:22.331037 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8c8b-c0aa-487f-878f-12d942b0c04e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.331319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8c8b-c0aa-487f-878f-12d942b0c04e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.331631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8c8b-c0aa-487f-878f-12d942b0c04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.367732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-56db8c8b-c0aa-487f-878f-12d942b0c04e None None] MFA Rules not processed for user `ee0dba644ddf40628e05534d5362eff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:22.368939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-56db8c8b-c0aa-487f-878f-12d942b0c04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:22.454769 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1362/2724] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:05:22.459480 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.473803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:22.529709 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc591f3-bf5c-45cd-b0c1-1362279b2d05 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.535039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.535645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.536000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.537341 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.538006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.541060 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.572360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1363/2725] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:22 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:22.576622 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8c8b-c0aa-487f-878f-12d942b0c04e None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.590588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8c8b-c0aa-487f-878f-12d942b0c04e None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.651897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.652512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.652787 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.653059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.653723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.655638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.677651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1363/2726] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:22 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:22.681719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.692148 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb55313-1afa-44de-967b-5e13e0d36e81 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.696877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.697501 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.697779 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.698050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.698691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.700258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.711545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1364/2727] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:05:22.715721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.720895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:22.728256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68a58-05d3-4601-96d0-0ab1173ef568 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.733081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.733764 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.734046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.734318 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] PATH_INFO: `/v3/projects/70876e442ea5447abc5b8e18a1504abd/users/d7caadf8e98f480d8f64b8369497481c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.755487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70876e442ea5447abc5b8e18a1504abd, user_id=d7caadf8e98f480d8f64b8369497481c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.758303 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.774351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1364/2728] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:22 2022] PUT /identity/v3/projects/70876e442ea5447abc5b8e18a1504abd/users/d7caadf8e98f480d8f64b8369497481c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:22.778327 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.788907 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c114-1b60-439f-b1d0-87cf223b4d01 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.845178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb35ad-1c5f-4007-b2b7-b74db1942195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.845714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb35ad-1c5f-4007-b2b7-b74db1942195 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.845991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb35ad-1c5f-4007-b2b7-b74db1942195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.846263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb35ad-1c5f-4007-b2b7-b74db1942195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.846905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb35ad-1c5f-4007-b2b7-b74db1942195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.848511 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb35ad-1c5f-4007-b2b7-b74db1942195 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.859413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1365/2729] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:22.863613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:22.874260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc61bfc-dff4-4981-b24a-a5da11654a42 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:22.879063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:22.879704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.879988 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.880259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] PATH_INFO: `/v3/projects/70876e442ea5447abc5b8e18a1504abd/users/d7caadf8e98f480d8f64b8369497481c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.882329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70876e442ea5447abc5b8e18a1504abd, user_id=d7caadf8e98f480d8f64b8369497481c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:22.884935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:22.895505 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1365/2730] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:22 2022] PUT /identity/v3/projects/70876e442ea5447abc5b8e18a1504abd/users/d7caadf8e98f480d8f64b8369497481c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:22.906425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254fed8-f67b-45e4-8626-48edeb84e0c4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:22.906712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254fed8-f67b-45e4-8626-48edeb84e0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:22.906987 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254fed8-f67b-45e4-8626-48edeb84e0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:22.935634 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6254fed8-f67b-45e4-8626-48edeb84e0c4 None None] MFA Rules not processed for user `d7caadf8e98f480d8f64b8369497481c`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:22.936837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6254fed8-f67b-45e4-8626-48edeb84e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:23.013360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1366/2731] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:23.024768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:23.026561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:23.085760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b887e-ad03-4bd8-b54b-3efe7314649c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:23.090109 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0f8d8-211f-467a-b24e-200fdfe9ee1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:23.090724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0f8d8-211f-467a-b24e-200fdfe9ee1f service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:23.091001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0f8d8-211f-467a-b24e-200fdfe9ee1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:23.091270 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0f8d8-211f-467a-b24e-200fdfe9ee1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:23.100763 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0f8d8-211f-467a-b24e-200fdfe9ee1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:23.102287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0f8d8-211f-467a-b24e-200fdfe9ee1f service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:23.112017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1366/2732] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:23.249239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254fed8-f67b-45e4-8626-48edeb84e0c4 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:23.258991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:23.317788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254fed8-f67b-45e4-8626-48edeb84e0c4 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:23.322470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:23.323077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:23.323349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:23.323615 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] PATH_INFO: `/v3/users/ee0dba644ddf40628e05534d5362eff0` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:23.324701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0dba644ddf40628e05534d5362eff0)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:23.326610 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:23.372836 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0dba644ddf40628e05534d5362eff0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.384544 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0dba644ddf40628e05534d5362eff0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.391853 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0dba644ddf40628e05534d5362eff0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.392464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0dba644ddf40628e05534d5362eff0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.400057 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0dba644ddf40628e05534d5362eff0'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.405805 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1367/2733] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:23 2022] DELETE /identity/v3/users/ee0dba644ddf40628e05534d5362eff0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:23.410339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:23.410613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:23.410878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:23.430692 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:23.431932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:23.490786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1367/2734] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:23.500725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:23.502122 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:23.562248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84f09-2ce5-4b70-82c9-98b92f947754 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:23.565909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:23.566503 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:23.566780 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:23.567048 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:23.576242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:23.577702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:23.587567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1368/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:23.849932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:23.851345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:23.863619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb216-a6da-419d-a692-59934f5e2720 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:23.869206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:23.869836 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:23.870369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:23.870645 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] PATH_INFO: `/v3/projects/8663b30d418c4f5cb261759ab2efb33b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:23.871793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8663b30d418c4f5cb261759ab2efb33b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:23.873880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:23.925579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8663b30d418c4f5cb261759ab2efb33b', 'request_id': 'req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.933684 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8663b30d418c4f5cb261759ab2efb33b', 'request_id': 'req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.938662 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:23.940000 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8663b30d418c4f5cb261759ab2efb33b', 'request_id': 'req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.953471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] The token cache is being invalidate because project 8663b30d418c4f5cb261759ab2efb33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:23.953758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.954427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:23.955942 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1368/2736] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:23 2022] DELETE /identity/v3/projects/8663b30d418c4f5cb261759ab2efb33b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:23.959918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:23.970274 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260ff1-f589-47f7-89a2-51880ab5774f service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:23.998741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:24.029930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.030551 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.030832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.031103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] PATH_INFO: `/v3/users/d7caadf8e98f480d8f64b8369497481c` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.032202 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7caadf8e98f480d8f64b8369497481c)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.034130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.079405 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7caadf8e98f480d8f64b8369497481c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.091243 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7caadf8e98f480d8f64b8369497481c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.097923 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7caadf8e98f480d8f64b8369497481c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.098659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7caadf8e98f480d8f64b8369497481c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.105961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-5ab68c88-6cf1-4a38-9482-4614b91212c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7caadf8e98f480d8f64b8369497481c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.111664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1369/2737] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:23 2022] DELETE /identity/v3/users/d7caadf8e98f480d8f64b8369497481c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:24.401371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:24.402841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:24.416434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139a6b0-393f-4f9a-ab33-5e352cd5f12c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:24.475072 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.475647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.475925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.476208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] PATH_INFO: `/v3/projects/70876e442ea5447abc5b8e18a1504abd` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.477946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70876e442ea5447abc5b8e18a1504abd)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.479825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.525002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70876e442ea5447abc5b8e18a1504abd', 'request_id': 'req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.532079 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70876e442ea5447abc5b8e18a1504abd', 'request_id': 'req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.537486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70876e442ea5447abc5b8e18a1504abd', 'request_id': 'req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.548771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] The token cache is being invalidate because project 70876e442ea5447abc5b8e18a1504abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:24.549054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.549715 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5fc0dd9b-28ab-417d-a1bf-c999a08b5a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:24.551170 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1369/2738] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:24 2022] DELETE /identity/v3/projects/70876e442ea5447abc5b8e18a1504abd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:05:24.556739 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd065a-ae1e-4ea3-b779-eb58c8fa388b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.557019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd065a-ae1e-4ea3-b779-eb58c8fa388b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.557325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd065a-ae1e-4ea3-b779-eb58c8fa388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.577130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-89fd065a-ae1e-4ea3-b779-eb58c8fa388b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:24.578363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-89fd065a-ae1e-4ea3-b779-eb58c8fa388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:24.636798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1370/2739] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:24.644459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cc3f-d01b-46ed-9a3c-1f0bdbeee7bf None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.644866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cc3f-d01b-46ed-9a3c-1f0bdbeee7bf None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.645167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cc3f-d01b-46ed-9a3c-1f0bdbeee7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.665614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9784cc3f-d01b-46ed-9a3c-1f0bdbeee7bf None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:24.666793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9784cc3f-d01b-46ed-9a3c-1f0bdbeee7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:24.674504 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1370/2740] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:05:24.678765 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd065a-ae1e-4ea3-b779-eb58c8fa388b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:24.689093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd065a-ae1e-4ea3-b779-eb58c8fa388b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:24.693910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.694502 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.694776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.695062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] PATH_INFO: `/v3/domains` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.695932 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:05:24.696389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.697991 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.709265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1371/2741] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:05:24.713610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cc3f-d01b-46ed-9a3c-1f0bdbeee7bf None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:24.722730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cc3f-d01b-46ed-9a3c-1f0bdbeee7bf None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:24.728056 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.728609 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.728886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.729173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.729809 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.731688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.776374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1371/2742] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:24 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:05:24.780740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:24.791351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760bb8d-9461-4c5c-a469-c847f3b1d086 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:24.823534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:24.849277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.849865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.850139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.851090 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.852359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.854350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.875206 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1372/2743] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:24 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:24.879459 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:24.889866 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fef27-b5f8-4b56-89c0-0158d71a1eb7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:24.894392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.894973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.895247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.895514 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.896145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.897748 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.907998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1372/2744] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:24.911899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:24.922399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd90de-d04e-45ce-b059-0b07e9baaa23 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:24.927051 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8aa275-451f-4245-a34e-01f868b5fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.927631 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aa275-451f-4245-a34e-01f868b5fb01 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.927906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aa275-451f-4245-a34e-01f868b5fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.928175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aa275-451f-4245-a34e-01f868b5fb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.928803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8aa275-451f-4245-a34e-01f868b5fb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.930407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8aa275-451f-4245-a34e-01f868b5fb01 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.940165 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1373/2745] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:24.944640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:24.955310 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4f418-ae5d-4385-a5b5-377b9b8b2151 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:24.960542 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:24.961791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:24.962211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:24.962485 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] PATH_INFO: `/v3/projects/22e200315071415796a8b1a5dec961df/users/ee60b4ee9ada4701a14de7c6774da82e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:24.977878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e200315071415796a8b1a5dec961df, user_id=ee60b4ee9ada4701a14de7c6774da82e, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:24.980565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:24.993411 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1373/2746] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:24 2022] PUT /identity/v3/projects/22e200315071415796a8b1a5dec961df/users/ee60b4ee9ada4701a14de7c6774da82e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:25.004901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3d9c-b30a-4eb1-99e8-ee07ecf87a1f None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.005406 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3d9c-b30a-4eb1-99e8-ee07ecf87a1f None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.005497 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3d9c-b30a-4eb1-99e8-ee07ecf87a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.033092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-415f3d9c-b30a-4eb1-99e8-ee07ecf87a1f None None] MFA Rules not processed for user `ee60b4ee9ada4701a14de7c6774da82e`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:25.034325 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-415f3d9c-b30a-4eb1-99e8-ee07ecf87a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:25.098546 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1374/2747] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:25.103860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:25.123586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:25.167874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08353c47-9dde-41eb-b7b6-9e2dfacd04e5 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:25.172401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:25.172985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.173294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.173557 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.174169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:25.176029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:25.202957 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1374/2748] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:25 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:25.207365 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3d9c-b30a-4eb1-99e8-ee07ecf87a1f None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:25.218472 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3d9c-b30a-4eb1-99e8-ee07ecf87a1f None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:25.274835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:25.275355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.275629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.275897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] PATH_INFO: `/v3/users` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.276526 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:25.278434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:25.298869 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1375/2749] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:25 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:05:25.303076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:25.313424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16bf7-4196-476b-b56a-6f1fc1c81b8b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:25.317991 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:25.318579 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.318859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.319131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.319767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:25.322130 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:25.332374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1375/2750] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:25.336990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:25.346782 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7e2b-a332-4733-b665-707bc7c60c9a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:25.351330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:25.352080 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.352382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.352670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] PATH_INFO: `/v3/projects/4eef96d976e14b9bab9a9c03b91bd96f/users/c0e171e8d1464d08881f37f1bf828b0e/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.366859 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eef96d976e14b9bab9a9c03b91bd96f, user_id=c0e171e8d1464d08881f37f1bf828b0e, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:25.369682 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:25.382006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1376/2751] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:25 2022] PUT /identity/v3/projects/4eef96d976e14b9bab9a9c03b91bd96f/users/c0e171e8d1464d08881f37f1bf828b0e/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:05:25.388460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:25.398527 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35089-ea15-430d-99b8-627b957181ae admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:25.458480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103f232-b535-4cae-853a-bf665ffc5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:25.459134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f232-b535-4cae-853a-bf665ffc5a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.459401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f232-b535-4cae-853a-bf665ffc5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.459779 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103f232-b535-4cae-853a-bf665ffc5a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.460479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103f232-b535-4cae-853a-bf665ffc5a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:25.462688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103f232-b535-4cae-853a-bf665ffc5a37 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:25.472928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1376/2752] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:25.477518 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:25.488023 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958f318-341e-4532-9438-1503f54b0680 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:25.493019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:25.493730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.494014 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.494287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] PATH_INFO: `/v3/projects/4eef96d976e14b9bab9a9c03b91bd96f/users/c0e171e8d1464d08881f37f1bf828b0e/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.497107 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eef96d976e14b9bab9a9c03b91bd96f, user_id=c0e171e8d1464d08881f37f1bf828b0e, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:25.499759 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:25.505605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:25.522004 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1377/2753] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:25 2022] PUT /identity/v3/projects/4eef96d976e14b9bab9a9c03b91bd96f/users/c0e171e8d1464d08881f37f1bf828b0e/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:05:25.524827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05aa85-9fc9-44ec-b6eb-064c5f28513c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.524827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05aa85-9fc9-44ec-b6eb-064c5f28513c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.524827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05aa85-9fc9-44ec-b6eb-064c5f28513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.553378 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-eb05aa85-9fc9-44ec-b6eb-064c5f28513c None None] MFA Rules not processed for user `c0e171e8d1464d08881f37f1bf828b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:25.554587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-eb05aa85-9fc9-44ec-b6eb-064c5f28513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:25.623402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1377/2754] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:25.635917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:25.637705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:25.696139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8534d-82da-4ae4-9034-8317cda4ad03 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:25.699818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa48dd-7c86-4208-98fc-ba6ca3441475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:25.700412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa48dd-7c86-4208-98fc-ba6ca3441475 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:25.700691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa48dd-7c86-4208-98fc-ba6ca3441475 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:25.700980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa48dd-7c86-4208-98fc-ba6ca3441475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:25.709773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa48dd-7c86-4208-98fc-ba6ca3441475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:25.711213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa48dd-7c86-4208-98fc-ba6ca3441475 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:25.720349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1378/2755] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:26.092778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05aa85-9fc9-44ec-b6eb-064c5f28513c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:26.105946 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:26.156792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05aa85-9fc9-44ec-b6eb-064c5f28513c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:26.161260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:26.161882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:26.162158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:26.162427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] PATH_INFO: `/v3/users/ee60b4ee9ada4701a14de7c6774da82e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:26.163535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee60b4ee9ada4701a14de7c6774da82e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:26.166142 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:26.210424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee60b4ee9ada4701a14de7c6774da82e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.219196 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee60b4ee9ada4701a14de7c6774da82e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.220023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee60b4ee9ada4701a14de7c6774da82e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.232773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee60b4ee9ada4701a14de7c6774da82e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.239636 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee60b4ee9ada4701a14de7c6774da82e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.246435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1378/2756] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:26 2022] DELETE /identity/v3/users/ee60b4ee9ada4701a14de7c6774da82e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:26.250930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:26.251408 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:26.251527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:26.271098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:26.272303 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:26.330245 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1379/2757] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:26.340450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:26.341852 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:26.399339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086d192-59db-4b57-9e55-f4b15c50a018 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:26.403028 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:26.403625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:26.403911 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:26.404184 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:26.413161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:26.415473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:26.424867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1379/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:26.773350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:26.791572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:26.809181 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db183a-0eb5-4d37-9a1b-d613d23089a6 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:26.813801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:26.814417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:26.814691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:26.814957 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] PATH_INFO: `/v3/projects/22e200315071415796a8b1a5dec961df` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:26.816109 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e200315071415796a8b1a5dec961df)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:26.818022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:26.863829 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e200315071415796a8b1a5dec961df', 'request_id': 'req-57777f6c-a5a0-4954-a689-77f471e5c4fa'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.870894 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e200315071415796a8b1a5dec961df', 'request_id': 'req-57777f6c-a5a0-4954-a689-77f471e5c4fa'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.876967 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e200315071415796a8b1a5dec961df', 'request_id': 'req-57777f6c-a5a0-4954-a689-77f471e5c4fa'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.888776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] The token cache is being invalidate because project 22e200315071415796a8b1a5dec961df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:26.889062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.889733 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:26.891195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1380/2759] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:26 2022] DELETE /identity/v3/projects/22e200315071415796a8b1a5dec961df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:26.895177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:26.905853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929095-2c4f-4f59-8a96-cd9008a534d5 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:26.937974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:26.964074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:26.964672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:26.964945 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:26.965243 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] PATH_INFO: `/v3/users/c0e171e8d1464d08881f37f1bf828b0e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:26.966343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e171e8d1464d08881f37f1bf828b0e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:26.968264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.013826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e171e8d1464d08881f37f1bf828b0e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.020930 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e171e8d1464d08881f37f1bf828b0e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.021553 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e171e8d1464d08881f37f1bf828b0e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.033967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e171e8d1464d08881f37f1bf828b0e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.041396 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-3ea25b60-7d8d-4e70-951a-ed129f997303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e171e8d1464d08881f37f1bf828b0e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.047206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1380/2760] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:26 2022] DELETE /identity/v3/users/c0e171e8d1464d08881f37f1bf828b0e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:27.317139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:27.318596 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:27.332214 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777f6c-a5a0-4954-a689-77f471e5c4fa admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:27.353101 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:27.391529 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:27.392077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.392354 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.392623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] PATH_INFO: `/v3/projects/4eef96d976e14b9bab9a9c03b91bd96f` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.393769 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eef96d976e14b9bab9a9c03b91bd96f)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:27.395648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.442066 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eef96d976e14b9bab9a9c03b91bd96f', 'request_id': 'req-c7f5a605-ff1a-4e7e-9052-942257445b11'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.450163 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eef96d976e14b9bab9a9c03b91bd96f', 'request_id': 'req-c7f5a605-ff1a-4e7e-9052-942257445b11'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.456542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eef96d976e14b9bab9a9c03b91bd96f', 'request_id': 'req-c7f5a605-ff1a-4e7e-9052-942257445b11'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.468299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] The token cache is being invalidate because project 4eef96d976e14b9bab9a9c03b91bd96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:27.468584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.469364 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-c7f5a605-ff1a-4e7e-9052-942257445b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:27.470830 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1381/2761] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:27 2022] DELETE /identity/v3/projects/4eef96d976e14b9bab9a9c03b91bd96f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:27.475839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38077097-5fc2-4d5e-a06f-48ee400b38c9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.476343 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38077097-5fc2-4d5e-a06f-48ee400b38c9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.476442 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38077097-5fc2-4d5e-a06f-48ee400b38c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.496206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-38077097-5fc2-4d5e-a06f-48ee400b38c9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:27.497436 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-38077097-5fc2-4d5e-a06f-48ee400b38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:27.554397 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1381/2762] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:27.563343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fcddc-21ac-41d2-97b6-e058c2ebba37 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.563625 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fcddc-21ac-41d2-97b6-e058c2ebba37 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.563895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fcddc-21ac-41d2-97b6-e058c2ebba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.584486 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-b50fcddc-21ac-41d2-97b6-e058c2ebba37 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:27.585705 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b50fcddc-21ac-41d2-97b6-e058c2ebba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:27.594698 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1382/2763] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:27.598802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38077097-5fc2-4d5e-a06f-48ee400b38c9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:27.608713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38077097-5fc2-4d5e-a06f-48ee400b38c9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:27.613372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:27.613986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.614258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.614529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.615167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:05:27.615464 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:27.617083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.629104 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1382/2764] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:05:27.633781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fcddc-21ac-41d2-97b6-e058c2ebba37 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:27.642998 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fcddc-21ac-41d2-97b6-e058c2ebba37 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:27.647561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:27.648317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.648641 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.649445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.650116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:27.652093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.680208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1383/2765] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:27 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:27.684471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:27.694398 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481d64e-5453-49b2-9c06-f32eb8117211 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:27.733965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:27.753077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:27.753710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.753989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.754263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.754892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:27.756791 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.779242 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1383/2766] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:27 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:05:27.783533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:27.793825 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f2b8b-c30a-4a38-ade8-c0f72538689d admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:27.798368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:27.798951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.799226 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.799494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.800127 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:27.801754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.812494 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1384/2767] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:27.816218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:27.827078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ff00-f87c-4127-9837-3dc2e393354c admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:27.831635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cd833-323b-47b0-84e7-610f03e69ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:27.832225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cd833-323b-47b0-84e7-610f03e69ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.832501 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cd833-323b-47b0-84e7-610f03e69ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.832771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cd833-323b-47b0-84e7-610f03e69ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.833450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cd833-323b-47b0-84e7-610f03e69ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:27.835027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cd833-323b-47b0-84e7-610f03e69ebe admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.845973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1384/2768] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:27.850158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:27.860298 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8e41-5210-4a04-a5b5-68703a575a51 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:27.864977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:27.865662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.865938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.866208 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] PATH_INFO: `/v3/projects/b7960a1fe9694e38b32cb4dbadeb58e2/users/9676e12cbaa940b8b581ff21315f5e7b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.882787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7960a1fe9694e38b32cb4dbadeb58e2, user_id=9676e12cbaa940b8b581ff21315f5e7b, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:27.886295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:27.899902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1385/2769] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:27 2022] PUT /identity/v3/projects/b7960a1fe9694e38b32cb4dbadeb58e2/users/9676e12cbaa940b8b581ff21315f5e7b/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:27.910275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7015bc-db6b-40d2-9c18-6c4d1ae1ec28 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:27.910627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7015bc-db6b-40d2-9c18-6c4d1ae1ec28 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:27.910960 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7015bc-db6b-40d2-9c18-6c4d1ae1ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:27.939226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-bf7015bc-db6b-40d2-9c18-6c4d1ae1ec28 None None] MFA Rules not processed for user `9676e12cbaa940b8b581ff21315f5e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:27.940418 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-bf7015bc-db6b-40d2-9c18-6c4d1ae1ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:28.012474 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1385/2770] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:28.024573 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:28.026277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:28.093916 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6838d-4086-4692-9575-7649d8eb3afa admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:28.097630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3699c-4fe1-4909-8e20-5ce214cee30b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:28.098231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3699c-4fe1-4909-8e20-5ce214cee30b service glance] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:28.098517 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3699c-4fe1-4909-8e20-5ce214cee30b service glance] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:28.098816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3699c-4fe1-4909-8e20-5ce214cee30b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:28.104084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:28.109000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3699c-4fe1-4909-8e20-5ce214cee30b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:28.110822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3699c-4fe1-4909-8e20-5ce214cee30b service glance] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:28.121861 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1386/2771] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:05:38.009537 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:38.116726 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:53.868622 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7015bc-db6b-40d2-9c18-6c4d1ae1ec28 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:53.930324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7015bc-db6b-40d2-9c18-6c4d1ae1ec28 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:53.934816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:53.935428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:53.935704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:53.935974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] PATH_INFO: `/v3/users/9676e12cbaa940b8b581ff21315f5e7b` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:53.937280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9676e12cbaa940b8b581ff21315f5e7b)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:53.939175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:53.985333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9676e12cbaa940b8b581ff21315f5e7b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:53.991833 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9676e12cbaa940b8b581ff21315f5e7b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:53.992428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9676e12cbaa940b8b581ff21315f5e7b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.004486 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9676e12cbaa940b8b581ff21315f5e7b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.011347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9676e12cbaa940b8b581ff21315f5e7b'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.017679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1386/2772] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:05:53 2022] DELETE /identity/v3/users/9676e12cbaa940b8b581ff21315f5e7b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:54.022100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.022565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.022686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.041777 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:54.042960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:54.100086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1387/2773] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:54.110377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.111776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:54.168262 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfd1d-f78e-45e5-94b8-c7530949f1a4 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.172444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7e81d-0c5a-424e-9b54-36a2167dd284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.173035 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7e81d-0c5a-424e-9b54-36a2167dd284 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.173348 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7e81d-0c5a-424e-9b54-36a2167dd284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.173618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7e81d-0c5a-424e-9b54-36a2167dd284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.182395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7e81d-0c5a-424e-9b54-36a2167dd284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.183784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7e81d-0c5a-424e-9b54-36a2167dd284 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:54.192924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1387/2774] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:05:54.463313 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.464844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:54.477587 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d105-a453-437c-bda8-a63d5d52a1ea None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.482205 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.482826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.483100 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.483369 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] PATH_INFO: `/v3/projects/b7960a1fe9694e38b32cb4dbadeb58e2` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.484664 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7960a1fe9694e38b32cb4dbadeb58e2)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.486572 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:54.542189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7960a1fe9694e38b32cb4dbadeb58e2', 'request_id': 'req-10098883-cb54-4c6b-98e5-77a02c2ed278'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.553000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7960a1fe9694e38b32cb4dbadeb58e2', 'request_id': 'req-10098883-cb54-4c6b-98e5-77a02c2ed278'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.558852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7960a1fe9694e38b32cb4dbadeb58e2', 'request_id': 'req-10098883-cb54-4c6b-98e5-77a02c2ed278'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.573802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] The token cache is being invalidate because project b7960a1fe9694e38b32cb4dbadeb58e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:05:54.574110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.574755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-10098883-cb54-4c6b-98e5-77a02c2ed278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:05:54.576221 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1388/2775] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:05:54 2022] DELETE /identity/v3/projects/b7960a1fe9694e38b32cb4dbadeb58e2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:54.581730 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd285-4732-406a-a959-d5d423dc30e9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.582083 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd285-4732-406a-a959-d5d423dc30e9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.582382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd285-4732-406a-a959-d5d423dc30e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.603117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-435fd285-4732-406a-a959-d5d423dc30e9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:54.604306 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-435fd285-4732-406a-a959-d5d423dc30e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:54.620767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:54.666172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1388/2776] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:54.674182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c97f-156d-47cd-84ca-111d3ffd9896 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.674533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c97f-156d-47cd-84ca-111d3ffd9896 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.674872 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c97f-156d-47cd-84ca-111d3ffd9896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.694659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9a63c97f-156d-47cd-84ca-111d3ffd9896 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:54.695903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9a63c97f-156d-47cd-84ca-111d3ffd9896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:54.704187 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1389/2777] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:54.708438 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fd285-4732-406a-a959-d5d423dc30e9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.717859 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fd285-4732-406a-a959-d5d423dc30e9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.722465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.723049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.723325 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.723591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.724228 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:05:54.724524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.726147 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:54.737475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1389/2778] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:05:54.741737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c97f-156d-47cd-84ca-111d3ffd9896 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.752263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c97f-156d-47cd-84ca-111d3ffd9896 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.756944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.757581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.757858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.758124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.758738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.760605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:54.795971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1390/2779] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:05:54 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:54.800244 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.809900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13a22-6ddb-488b-b3f0-f3ef32aca277 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.865530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.866117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.866392 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.866657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.867264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.869171 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:54.891186 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1390/2780] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:05:54 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:05:54.895492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.907179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf6e64-672d-4090-96a6-b3315c387e9a admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.912093 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.912680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.912960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.913269 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.913911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.915474 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:54.925380 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1391/2781] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:54.929421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.939736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297a5fc-1a82-4bbb-8ad0-4b53431178ac admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.944483 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc225d8-7a1e-403f-9dfc-c35a6fa0a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.945076 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc225d8-7a1e-403f-9dfc-c35a6fa0a408 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.945381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc225d8-7a1e-403f-9dfc-c35a6fa0a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.946052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc225d8-7a1e-403f-9dfc-c35a6fa0a408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.946284 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc225d8-7a1e-403f-9dfc-c35a6fa0a408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.947886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc225d8-7a1e-403f-9dfc-c35a6fa0a408 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:54.959724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1391/2782] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:05:54.964031 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:54.974473 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a3876-f8b2-42e5-b3d6-897da0437632 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:54.979242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:54.979913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:54.980188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:54.980458 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] PATH_INFO: `/v3/projects/4eb9b42aee254bc2a8164bed735bd697/users/e292a2f99e6a48ac934c56167ab7f747/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:54.995712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb9b42aee254bc2a8164bed735bd697, user_id=e292a2f99e6a48ac934c56167ab7f747, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:54.998622 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:55.012488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1392/2783] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:05:54 2022] PUT /identity/v3/projects/4eb9b42aee254bc2a8164bed735bd697/users/e292a2f99e6a48ac934c56167ab7f747/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:05:55.077711 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1d23-2c78-47b9-8b12-c3e011e0f488 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:55.077994 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1d23-2c78-47b9-8b12-c3e011e0f488 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:55.078266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb1d23-2c78-47b9-8b12-c3e011e0f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:55.105598 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c1fb1d23-2c78-47b9-8b12-c3e011e0f488 None None] MFA Rules not processed for user `e292a2f99e6a48ac934c56167ab7f747`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:05:55.106788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c1fb1d23-2c78-47b9-8b12-c3e011e0f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:55.170790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1392/2784] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:05:55.182482 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:05:55.184157 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:05:55.198188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:55.242505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac35f1e-3532-44ba-89d6-a2968a627730 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:05:55.246459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a14da-c075-402e-a651-35f2b2819720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:05:55.247045 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a14da-c075-402e-a651-35f2b2819720 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:05:55.247317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a14da-c075-402e-a651-35f2b2819720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:05:55.247583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a14da-c075-402e-a651-35f2b2819720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:05:55.256505 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a14da-c075-402e-a651-35f2b2819720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:05:55.257965 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a14da-c075-402e-a651-35f2b2819720 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:05:55.266918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1393/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:05:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:05.167897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:05.262781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=21 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:29.309268 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1d23-2c78-47b9-8b12-c3e011e0f488 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:29.379280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb1d23-2c78-47b9-8b12-c3e011e0f488 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:29.383758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:29.384376 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:29.384650 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:29.384918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] PATH_INFO: `/v3/users/e292a2f99e6a48ac934c56167ab7f747` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:29.386046 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e292a2f99e6a48ac934c56167ab7f747)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:29.387929 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:29.434307 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e292a2f99e6a48ac934c56167ab7f747'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:29.441554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e292a2f99e6a48ac934c56167ab7f747'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:29.442165 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e292a2f99e6a48ac934c56167ab7f747'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:29.454927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e292a2f99e6a48ac934c56167ab7f747'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:29.463129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e292a2f99e6a48ac934c56167ab7f747'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:29.469625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1393/2786] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:06:29 2022] DELETE /identity/v3/users/e292a2f99e6a48ac934c56167ab7f747 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:06:29.474158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:29.474618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:29.474822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:29.497742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:29.498936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:29.556124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1394/2787] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:29.566152 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:29.567575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:29.624517 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea40d5-e838-4f9c-8155-1ce13585c282 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:29.628154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44bb6b-7f1b-4ac6-9d73-20c5c273484c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:29.628778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44bb6b-7f1b-4ac6-9d73-20c5c273484c service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:29.629055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44bb6b-7f1b-4ac6-9d73-20c5c273484c service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:29.629351 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44bb6b-7f1b-4ac6-9d73-20c5c273484c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:29.638219 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44bb6b-7f1b-4ac6-9d73-20c5c273484c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:29.639625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44bb6b-7f1b-4ac6-9d73-20c5c273484c service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:29.649641 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1394/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:29.923287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:29.924790 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:29.942366 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9060f3-0ebf-49f4-a13e-1277da5fa6c7 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:29.947804 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:29.948818 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:29.949332 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:29.949823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] PATH_INFO: `/v3/projects/4eb9b42aee254bc2a8164bed735bd697` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:29.951172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb9b42aee254bc2a8164bed735bd697)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:29.953810 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:29.999533 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb9b42aee254bc2a8164bed735bd697', 'request_id': 'req-946e6932-8fb9-41ad-995a-b75070e8bf3e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:30.007508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb9b42aee254bc2a8164bed735bd697', 'request_id': 'req-946e6932-8fb9-41ad-995a-b75070e8bf3e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:30.013288 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb9b42aee254bc2a8164bed735bd697', 'request_id': 'req-946e6932-8fb9-41ad-995a-b75070e8bf3e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:30.024564 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] The token cache is being invalidate because project 4eb9b42aee254bc2a8164bed735bd697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:06:30.024856 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:30.025555 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-946e6932-8fb9-41ad-995a-b75070e8bf3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:06:30.027123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1395/2789] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:06:29 2022] DELETE /identity/v3/projects/4eb9b42aee254bc2a8164bed735bd697 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:06:30.032674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d68be-5422-4aa3-8189-2c80a88a1d34 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.033026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d68be-5422-4aa3-8189-2c80a88a1d34 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.033390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d68be-5422-4aa3-8189-2c80a88a1d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.053510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-326d68be-5422-4aa3-8189-2c80a88a1d34 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:30.054707 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-326d68be-5422-4aa3-8189-2c80a88a1d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:30.072009 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:30.115851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1395/2790] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:30.123813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019a24-58c6-4eb2-8d54-486e1859d89a None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.124098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019a24-58c6-4eb2-8d54-486e1859d89a None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.124378 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019a24-58c6-4eb2-8d54-486e1859d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.146161 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-52019a24-58c6-4eb2-8d54-486e1859d89a None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:30.147489 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-52019a24-58c6-4eb2-8d54-486e1859d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:30.155735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1396/2791] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:30.159984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d68be-5422-4aa3-8189-2c80a88a1d34 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:30.169535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d68be-5422-4aa3-8189-2c80a88a1d34 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:30.174493 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:30.175095 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.175371 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.175641 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.176288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:06:30.176590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:30.178209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:30.190309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1396/2792] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:06:30.194513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52019a24-58c6-4eb2-8d54-486e1859d89a None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:30.204355 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52019a24-58c6-4eb2-8d54-486e1859d89a None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:30.208944 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:30.209553 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.209833 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.210102 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.210732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:30.212602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:30.240837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1397/2793] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:06:30 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:06:30.245103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:30.255919 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557ac3f-6e83-4ff5-81b6-5d632baa7df3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:30.310272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:30.310892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.311140 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.311410 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.312042 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:30.314602 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:30.335107 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1397/2794] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:06:30 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:06:30.339382 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:30.349425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1e2c-560b-42df-85f2-8b0e20f6bceb admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:30.354043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:30.354630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.354906 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.355178 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.355816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:30.357459 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:30.367963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1398/2795] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:06:30.372006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:30.382561 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d9f44-2195-4c2f-b7fc-d4905c6e2ee7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:30.387206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2b6d-f222-4c54-a6b3-a83f6e2132e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:30.387795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2b6d-f222-4c54-a6b3-a83f6e2132e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.388069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2b6d-f222-4c54-a6b3-a83f6e2132e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.388336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2b6d-f222-4c54-a6b3-a83f6e2132e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.388968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2b6d-f222-4c54-a6b3-a83f6e2132e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:30.390629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2b6d-f222-4c54-a6b3-a83f6e2132e9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:30.401916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1398/2796] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:06:30.406044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:30.416077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b611f0-16f4-420a-894a-125ba10e61f9 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:30.420654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:30.421321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.422172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.422731 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] PATH_INFO: `/v3/projects/0a514a384742409d86c6cb7e1c10434a/users/1e499a55a3b141879719fbc1856d3350/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.436775 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a514a384742409d86c6cb7e1c10434a, user_id=1e499a55a3b141879719fbc1856d3350, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:30.440190 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:30.452690 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1399/2797] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:06:30 2022] PUT /identity/v3/projects/0a514a384742409d86c6cb7e1c10434a/users/1e499a55a3b141879719fbc1856d3350/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:06:30.457753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8097d3-6497-4d88-bcea-58ef4f3e17ee None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.458055 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8097d3-6497-4d88-bcea-58ef4f3e17ee None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.458369 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8097d3-6497-4d88-bcea-58ef4f3e17ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.476998 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-9d8097d3-6497-4d88-bcea-58ef4f3e17ee None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:30.478225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9d8097d3-6497-4d88-bcea-58ef4f3e17ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:30.536237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1399/2798] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:30.547506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:30.549955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:30.573263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:30.611233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe1dc0-2791-42bf-9149-c1fec139d597 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:30.614893 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:30.615492 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:30.615767 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:30.616034 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:30.625177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:30.626542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:30.635929 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1400/2799] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:31.254552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a214b-a268-4f90-8928-3b63f5dc51c5 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:31.254840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a214b-a268-4f90-8928-3b63f5dc51c5 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:31.255116 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a214b-a268-4f90-8928-3b63f5dc51c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:31.283049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-344a214b-a268-4f90-8928-3b63f5dc51c5 None None] MFA Rules not processed for user `1e499a55a3b141879719fbc1856d3350`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:31.284412 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-344a214b-a268-4f90-8928-3b63f5dc51c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:31.301789 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:31.354407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1400/2800] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:31.366139 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:31.367583 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:31.427540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef08fc4-e7c6-4f8c-a61e-176a295790fc service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:31.431231 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:31.431768 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:31.432044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:31.432317 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:31.441387 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:31.442806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:31.451616 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1401/2801] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:32.815732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:32.816236 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:32.816353 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:32.834795 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] MFA Rules not processed for user `1e499a55a3b141879719fbc1856d3350`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:32.835974 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:32.842771 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1401/2802] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:32.882286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:32.883686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:32.940989 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7165fe-64c1-48c0-9b77-3445468c1333 service cinder] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:32.944488 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:32.945092 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:32.945399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:32.945670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:32.947374 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:33.016604 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:33.018063 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:33.028673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1402/2803] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:06:33.566825 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:33.568200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:33.580765 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b21a3-49f1-44ee-b14e-afbb3d25856b None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:33.584509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d3780-3550-47f3-8e5b-1bf0b0550a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:33.585097 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3780-3550-47f3-8e5b-1bf0b0550a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:33.585416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3780-3550-47f3-8e5b-1bf0b0550a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:33.585685 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3780-3550-47f3-8e5b-1bf0b0550a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:33.587370 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f50d3780-3550-47f3-8e5b-1bf0b0550a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:33.601495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d3780-3550-47f3-8e5b-1bf0b0550a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:33.603054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d3780-3550-47f3-8e5b-1bf0b0550a69 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:33.614309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1402/2804] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:38.461752 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:38.471990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0673e6-9598-45d1-9c9d-e1ce9895e821 service glance] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:38.475593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:38.476177 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:38.476450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:38.476714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:38.478439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:38.484331 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:38.489437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:38.490832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:38.498891 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1403/2805] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:43.609651 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=28 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:45.565671 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:45.566372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:45.566372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:45.586420 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] MFA Rules not processed for user `8bab8f8c327d43e79bf5c6cf0a11549a`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:06:45.587606 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:45.644631 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1403/2806] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:06:46.320136 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:46.321633 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:46.405535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea50c-0faf-4383-9874-b6674ec522dc service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:46.411110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01704b-3c64-4b1c-97ab-932fda4352e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:46.411748 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01704b-3c64-4b1c-97ab-932fda4352e4 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:46.412037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01704b-3c64-4b1c-97ab-932fda4352e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:46.412338 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01704b-3c64-4b1c-97ab-932fda4352e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:46.414180 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ac01704b-3c64-4b1c-97ab-932fda4352e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:46.426417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01704b-3c64-4b1c-97ab-932fda4352e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:46.428003 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01704b-3c64-4b1c-97ab-932fda4352e4 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:46.438852 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1404/2807] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:06:55.637495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=25 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:56.433523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=35 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:59.298207 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:06:59.299601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:59.316790 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171a158-2897-447f-aae7-007b7ad22bc7 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:06:59.322234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:06:59.322837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:06:59.323114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:06:59.323385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:06:59.325081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:06:59.337716 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:06:59.339287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:06:59.350718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1404/2808] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:07:05.809622 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58640-45f6-4fe0-bc73-fa5ce9cbabdd None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:05.810201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58640-45f6-4fe0-bc73-fa5ce9cbabdd None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:05.810201 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58640-45f6-4fe0-bc73-fa5ce9cbabdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:05.829361 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4fd58640-45f6-4fe0-bc73-fa5ce9cbabdd None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:05.830586 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4fd58640-45f6-4fe0-bc73-fa5ce9cbabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:05.838955 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1405/2809] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:05.859928 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:05.871407 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac10c-b753-4837-9933-25dd4138d634 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:05.876838 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:05.877455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:05.877732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:05.878002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:05.886190 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:05.887742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:05.897471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1405/2810] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:08.884359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb24b-1f8c-44c4-98dc-141613059af1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:08.884904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb24b-1f8c-44c4-98dc-141613059af1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:08.884904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb24b-1f8c-44c4-98dc-141613059af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:08.904370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-024fb24b-1f8c-44c4-98dc-141613059af1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:08.905611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-024fb24b-1f8c-44c4-98dc-141613059af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:08.913523 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1406/2811] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:08.934923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:08.936297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:08.951193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418606-7b99-4ce4-a417-4459900cea6e service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:08.956689 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:08.957317 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:08.957599 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:08.957887 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:08.965742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:08.967297 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:08.977113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1406/2812] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:18.308990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db393eaa-0aa6-4208-a50f-165946e57eef None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:18.309588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db393eaa-0aa6-4208-a50f-165946e57eef None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:18.309588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db393eaa-0aa6-4208-a50f-165946e57eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:18.328510 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-db393eaa-0aa6-4208-a50f-165946e57eef None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:18.329740 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db393eaa-0aa6-4208-a50f-165946e57eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:18.337545 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1407/2813] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:18.360913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:18.373495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f03906-6ca4-413b-9b04-a4ce326f7e92 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:18.379679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:18.380342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:18.380621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:18.380892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:18.389334 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:18.390880 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:18.400295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1407/2814] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:21.391094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398942cd-9225-442a-ba55-c97fe8d89231 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:21.391626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398942cd-9225-442a-ba55-c97fe8d89231 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:21.391626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398942cd-9225-442a-ba55-c97fe8d89231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:21.411629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-398942cd-9225-442a-ba55-c97fe8d89231 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:21.412823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-398942cd-9225-442a-ba55-c97fe8d89231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:21.420687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1408/2815] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:21.443456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:21.454614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e478-e24b-4a3e-b790-e42b121831d1 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:21.460601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:21.461217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:21.461498 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:21.461770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:21.469874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:21.471421 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:21.481181 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1408/2816] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:25.614783 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a350-f3c3-4bc8-846d-80f90cb9b205 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:25.615330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a350-f3c3-4bc8-846d-80f90cb9b205 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:25.615330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a350-f3c3-4bc8-846d-80f90cb9b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:25.635026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4c63a350-f3c3-4bc8-846d-80f90cb9b205 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:25.636215 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4c63a350-f3c3-4bc8-846d-80f90cb9b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:25.643904 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1409/2817] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:25.679583 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:25.685125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=31 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:25.692163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63837a3-e039-4417-8818-57a57514ee08 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:25.697624 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:25.698212 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:25.698490 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:25.698759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:25.707524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:25.709261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:25.718555 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1409/2818] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:28.749813 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa085a8a-3e21-4528-870d-cd7159ee4e57 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:28.750351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa085a8a-3e21-4528-870d-cd7159ee4e57 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:28.750469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa085a8a-3e21-4528-870d-cd7159ee4e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:28.758169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=16 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:28.771147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-fa085a8a-3e21-4528-870d-cd7159ee4e57 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:28.772340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-fa085a8a-3e21-4528-870d-cd7159ee4e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:28.780131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1410/2819] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:28.801892 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:28.813049 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b724e-d682-4950-bef7-ee5765b94b10 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:28.818896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8f903-9646-4d22-87f0-6e8ad70ee2b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:28.819482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f903-9646-4d22-87f0-6e8ad70ee2b8 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:28.819761 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f903-9646-4d22-87f0-6e8ad70ee2b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:28.820031 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f903-9646-4d22-87f0-6e8ad70ee2b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:28.828158 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8f903-9646-4d22-87f0-6e8ad70ee2b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:28.829821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8f903-9646-4d22-87f0-6e8ad70ee2b8 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:28.839294 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1410/2820] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:38.548857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa085a8a-3e21-4528-870d-cd7159ee4e57 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:38.562909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa085a8a-3e21-4528-870d-cd7159ee4e57 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:38.568441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:38.569041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:38.569357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:38.569632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:38.571359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:38.584750 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:38.586392 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:38.598121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1411/2821] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:07:38.835081 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=11 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:43.868308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f590-a9b7-4b1b-9015-cbd4accb68ef None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:43.868894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f590-a9b7-4b1b-9015-cbd4accb68ef None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:43.868894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f590-a9b7-4b1b-9015-cbd4accb68ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:43.888197 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5654f590-a9b7-4b1b-9015-cbd4accb68ef None None] MFA Rules not processed for user `1e499a55a3b141879719fbc1856d3350`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:43.889433 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5654f590-a9b7-4b1b-9015-cbd4accb68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:43.896383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1411/2822] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:44.130578 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:44.139902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139443ba-f8ea-4bc7-84b9-8fdb83eb8ef6 service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:44.144343 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da1598-0f20-4a60-906c-23872fd3c976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:44.144676 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1598-0f20-4a60-906c-23872fd3c976 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:44.144953 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1598-0f20-4a60-906c-23872fd3c976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:44.145257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1598-0f20-4a60-906c-23872fd3c976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:44.147005 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-b2da1598-0f20-4a60-906c-23872fd3c976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:44.156599 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da1598-0f20-4a60-906c-23872fd3c976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:44.158064 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da1598-0f20-4a60-906c-23872fd3c976 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:44.166803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1412/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:53.001424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f590-a9b7-4b1b-9015-cbd4accb68ef None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:53.015395 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f590-a9b7-4b1b-9015-cbd4accb68ef None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:53.021301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:53.021910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:53.022193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:53.022462 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:53.024321 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:53.037390 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:53.038968 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:53.050567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1412/2824] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:07:54.163142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=14 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:58.942683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302edf9-0de0-401d-b5b0-d2307ff275c4 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:58.943320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302edf9-0de0-401d-b5b0-d2307ff275c4 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:58.943320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302edf9-0de0-401d-b5b0-d2307ff275c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:58.963134 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-9302edf9-0de0-401d-b5b0-d2307ff275c4 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:07:58.964320 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-9302edf9-0de0-401d-b5b0-d2307ff275c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:07:58.972384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1413/2825] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:07:58.992896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:07:59.004860 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdc68b-8a5a-48eb-80a8-10d6f1b768d7 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:07:59.010288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:07:59.010871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:07:59.011147 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:07:59.011416 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:07:59.019471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:07:59.021015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:07:59.030275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1413/2826] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:02.405137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59233-5043-4666-916f-ac3db343231e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:02.405685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59233-5043-4666-916f-ac3db343231e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:02.405814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59233-5043-4666-916f-ac3db343231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:02.426062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1fc59233-5043-4666-916f-ac3db343231e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:02.427223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1fc59233-5043-4666-916f-ac3db343231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:02.435046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1414/2827] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:08:02.457808 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:02.468843 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e71ce-4857-4019-89c5-4eaff459ea9d service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:02.474975 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:02.475556 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:02.475831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:02.476101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:02.484069 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:02.485655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:02.495993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1414/2828] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:05.475446 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d5535-e4bf-4400-bbdb-14301a757dd1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:05.475980 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d5535-e4bf-4400-bbdb-14301a757dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:05.476091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d5535-e4bf-4400-bbdb-14301a757dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:05.497032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-db4d5535-e4bf-4400-bbdb-14301a757dd1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:05.498275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-db4d5535-e4bf-4400-bbdb-14301a757dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:05.506801 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1415/2829] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:05.528718 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:05.539932 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002e92-667d-469e-ba9e-83fd2e87f328 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:05.545456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:05.546038 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:05.546314 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:05.546586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:05.554691 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:05.556234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:05.566156 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1415/2830] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:08.646420 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489f2d-6740-4262-917b-31c7ce4c1bfa None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:08.646960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489f2d-6740-4262-917b-31c7ce4c1bfa None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:08.646960 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7489f2d-6740-4262-917b-31c7ce4c1bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:08.666624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-e7489f2d-6740-4262-917b-31c7ce4c1bfa None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:08.667809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-e7489f2d-6740-4262-917b-31c7ce4c1bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:08.676204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1416/2831] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:08.698989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:08.710308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035014-fc5c-4477-bf31-77165dc52dc0 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:08.715710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:08.716288 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:08.716566 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:08.716956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:08.724985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:08.726589 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:08.736231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1416/2832] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:12.828333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a3f79-ddf6-4f10-a508-5c78d2dca58e None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:12.828838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a3f79-ddf6-4f10-a508-5c78d2dca58e None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:12.828936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a3f79-ddf6-4f10-a508-5c78d2dca58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:12.848605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-257a3f79-ddf6-4f10-a508-5c78d2dca58e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:12.849816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-257a3f79-ddf6-4f10-a508-5c78d2dca58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:12.857440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1417/2833] 10.222.0.95 () {58 vars in 1016 bytes} [Mon Sep 19 12:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:12.895997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:12.901915 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=34 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:12.908148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7aa2f2-b1fd-4e42-a0fc-68d8696b5526 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:12.913540 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:12.914125 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:12.914404 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:12.914675 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:12.922687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:12.924471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:12.933950 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1417/2834] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:14.290635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a3f79-ddf6-4f10-a508-5c78d2dca58e None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:14.304689 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a3f79-ddf6-4f10-a508-5c78d2dca58e None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:14.310020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:14.310602 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:14.310874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:14.311138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:14.312797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:14.323850 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:14.325423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:14.335235 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1418/2835] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:22.929574 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:24.331211 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=21 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:37.052169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:37.061530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b679f-254a-4522-8179-3bf8f8d9302b service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:37.065066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:37.065831 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:37.066110 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:37.066387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:37.068118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:37.079487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:37.081469 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:37.090965 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1418/2836] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:40.193427 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:40.195469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:40.210959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247612d-b180-4b6c-acc0-626f99c8ddff service nova] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:40.216019 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:40.216624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.217097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.217400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.220895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:40.239195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:40.241058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:40.253188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1419/2837] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:40.254604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:40.256157 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:40.270163 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd1cb-4a6e-45a8-9527-92e7639c376e service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:40.278003 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:40.278781 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.279159 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.279618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] PATH_INFO: `/v3/users/8bab8f8c327d43e79bf5c6cf0a11549a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.281017 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bab8f8c327d43e79bf5c6cf0a11549a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:40.283584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:40.343470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bab8f8c327d43e79bf5c6cf0a11549a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.351091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bab8f8c327d43e79bf5c6cf0a11549a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.351861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bab8f8c327d43e79bf5c6cf0a11549a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.364355 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bab8f8c327d43e79bf5c6cf0a11549a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.372206 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-61b02c75-1bf9-41a9-98fe-800da07afafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bab8f8c327d43e79bf5c6cf0a11549a'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.378331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1419/2838] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:40 2022] DELETE /identity/v3/users/8bab8f8c327d43e79bf5c6cf0a11549a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:40.554675 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:40.568340 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3380af5-71d2-4c7f-9d6c-fc36a6fe3d46 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:40.626135 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:40.626753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.627027 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.627293 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] PATH_INFO: `/v3/projects/37a038dbcd5d45e0a30a37113995a8bc` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.629286 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a038dbcd5d45e0a30a37113995a8bc)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:40.631158 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:40.679890 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a038dbcd5d45e0a30a37113995a8bc', 'request_id': 'req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.687402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a038dbcd5d45e0a30a37113995a8bc', 'request_id': 'req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.693691 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a038dbcd5d45e0a30a37113995a8bc', 'request_id': 'req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.704556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] The token cache is being invalidate because project 37a038dbcd5d45e0a30a37113995a8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:40.704843 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.705475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-7f7f930f-5f5b-44e2-8c8b-1c0201c3dd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:40.707936 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1420/2839] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:40 2022] DELETE /identity/v3/projects/37a038dbcd5d45e0a30a37113995a8bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:40.712778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb54b2c-aeda-4b33-a28d-df1fe78894c3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.713066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb54b2c-aeda-4b33-a28d-df1fe78894c3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.713374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb54b2c-aeda-4b33-a28d-df1fe78894c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.732597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-0fb54b2c-aeda-4b33-a28d-df1fe78894c3 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:40.733818 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-0fb54b2c-aeda-4b33-a28d-df1fe78894c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:40.793910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1420/2840] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:08:40.802169 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89746e7e-16ba-4d5e-a80f-ce0564dd8ee8 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.802485 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89746e7e-16ba-4d5e-a80f-ce0564dd8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.802755 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89746e7e-16ba-4d5e-a80f-ce0564dd8ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.822613 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-89746e7e-16ba-4d5e-a80f-ce0564dd8ee8 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:40.823807 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-89746e7e-16ba-4d5e-a80f-ce0564dd8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:40.832167 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1421/2841] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:40.836299 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb54b2c-aeda-4b33-a28d-df1fe78894c3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:40.846074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb54b2c-aeda-4b33-a28d-df1fe78894c3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:40.850967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:40.851552 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.851829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.852103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.852742 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:08:40.853043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:40.854655 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:40.866721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1421/2842] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:08:40.871062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89746e7e-16ba-4d5e-a80f-ce0564dd8ee8 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:40.880781 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89746e7e-16ba-4d5e-a80f-ce0564dd8ee8 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:40.885506 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:40.886097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.886370 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.886638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.887275 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:40.889196 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:40.916913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1422/2843] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:40 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:40.921119 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:40.932059 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c8608-5611-4b9d-a913-95299bac46e3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:40.976572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:40.992614 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:40.993231 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:40.993508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:40.994029 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:40.994656 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:40.996535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:41.018308 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1422/2844] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:40 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:41.022522 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:41.032749 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05f57-d387-467e-9931-a5352b9d6fc6 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:41.037607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:41.038193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:41.038464 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:41.038727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:41.039357 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:41.040911 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:41.051576 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1423/2845] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:41.055476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:41.066213 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b917a92-94b3-4db1-93f2-e86497ee3325 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:41.070896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc03fa0-7dca-4859-b22c-5fa63967bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:41.071484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc03fa0-7dca-4859-b22c-5fa63967bf8a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:41.071759 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc03fa0-7dca-4859-b22c-5fa63967bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:41.072026 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc03fa0-7dca-4859-b22c-5fa63967bf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:41.073215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc03fa0-7dca-4859-b22c-5fa63967bf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:41.074804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc03fa0-7dca-4859-b22c-5fa63967bf8a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:41.085347 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1423/2846] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:41.089402 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:41.099419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d489c9-935e-4319-96bc-a957ff1e40fd admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:41.104279 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:41.104951 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:41.105262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:41.105535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] PATH_INFO: `/v3/projects/d8ac9469bb2547e088f9f36378518723/users/cb254fc8c0294b8387ec8d94c2b523a6/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:41.120824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ac9469bb2547e088f9f36378518723, user_id=cb254fc8c0294b8387ec8d94c2b523a6, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:41.123561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:41.136905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1424/2847] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:41 2022] PUT /identity/v3/projects/d8ac9469bb2547e088f9f36378518723/users/cb254fc8c0294b8387ec8d94c2b523a6/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:08:41.141973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607f3a7-9cc5-4a5a-b634-31b912699ab3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:41.142263 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607f3a7-9cc5-4a5a-b634-31b912699ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:41.142536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607f3a7-9cc5-4a5a-b634-31b912699ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:41.160997 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c607f3a7-9cc5-4a5a-b634-31b912699ab3 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:41.162226 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c607f3a7-9cc5-4a5a-b634-31b912699ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:41.220872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1424/2848] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:41.231484 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:41.233240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:41.248632 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:41.292330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a85305-380e-4f49-89f3-c5b7741f397e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:41.296077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:41.296679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:41.296958 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:41.297257 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:41.306702 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:41.308094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:41.317453 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1425/2849] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:41.994154 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1780-c162-40c9-a95a-3d4eefc85855 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:41.994663 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1780-c162-40c9-a95a-3d4eefc85855 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:41.994867 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1780-c162-40c9-a95a-3d4eefc85855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:42.022513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-a1aa1780-c162-40c9-a95a-3d4eefc85855 None None] MFA Rules not processed for user `cb254fc8c0294b8387ec8d94c2b523a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:42.023731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a1aa1780-c162-40c9-a95a-3d4eefc85855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:42.089577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1425/2850] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:42.094172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:42.104560 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f216f4-b8d0-4767-9b86-90c055023b18 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:42.109316 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:42.109905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:42.110189 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:42.110460 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:42.111097 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:42.113674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:42.144377 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1426/2851] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:42 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:42.145619 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1780-c162-40c9-a95a-3d4eefc85855 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:42.156063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1780-c162-40c9-a95a-3d4eefc85855 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:42.207027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:42.214677 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:42.215274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:42.215551 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:42.215821 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:42.216451 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:42.218375 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:42.240590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1426/2852] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:42 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:08:42.244981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:42.255123 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ca0b5-77ae-43ee-af2e-b60ba0c81ea2 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:42.259684 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:42.260273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:42.260552 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:42.260822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:42.261493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:42.263065 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:42.273638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1427/2853] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 12:08:42.277719 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:42.288365 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039709d-8c0c-4167-8418-4405ac408439 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:42.293111 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:42.293805 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:42.294082 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:42.294354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] PATH_INFO: `/v3/projects/ed9a6e779866454fb67917598e48a68a/users/0d07132322a54ca49d538f66e204d62c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:42.309269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9a6e779866454fb67917598e48a68a, user_id=0d07132322a54ca49d538f66e204d62c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:42.311874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:42.324333 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1427/2854] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:42 2022] PUT /identity/v3/projects/ed9a6e779866454fb67917598e48a68a/users/0d07132322a54ca49d538f66e204d62c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:42.328287 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:42.339029 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afb91b-310f-443b-827c-99899d52f146 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:42.398679 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd901-8ca3-4fc3-a986-89ad4b837a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:42.399278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd901-8ca3-4fc3-a986-89ad4b837a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:42.399581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd901-8ca3-4fc3-a986-89ad4b837a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:42.399846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd901-8ca3-4fc3-a986-89ad4b837a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:42.400475 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd901-8ca3-4fc3-a986-89ad4b837a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:42.402070 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd901-8ca3-4fc3-a986-89ad4b837a43 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:42.416977 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1428/2855] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:42.421360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:42.431475 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8fee7-a35d-4834-8808-daed66c2c018 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:42.437913 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:42.438565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:42.438840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:42.439112 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] PATH_INFO: `/v3/projects/ed9a6e779866454fb67917598e48a68a/users/0d07132322a54ca49d538f66e204d62c/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:42.441052 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9a6e779866454fb67917598e48a68a, user_id=0d07132322a54ca49d538f66e204d62c, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:42.443680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:42.453977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1428/2856] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:42 2022] PUT /identity/v3/projects/ed9a6e779866454fb67917598e48a68a/users/0d07132322a54ca49d538f66e204d62c/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:43.112868 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a07d0-a4ef-4a12-b825-adaebbf1aa90 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:43.113290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a07d0-a4ef-4a12-b825-adaebbf1aa90 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:43.113571 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a07d0-a4ef-4a12-b825-adaebbf1aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:43.142821 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-208a07d0-a4ef-4a12-b825-adaebbf1aa90 None None] MFA Rules not processed for user `0d07132322a54ca49d538f66e204d62c`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:43.144291 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-208a07d0-a4ef-4a12-b825-adaebbf1aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:43.215909 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1429/2857] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:43.666479 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:43.668199 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:43.748897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fed38d-ac84-4f6a-9515-e3269a2ba6e2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:43.754287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:43.754904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:43.755177 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:43.755441 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:43.757309 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:43.769520 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:43.771131 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:43.782272 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1429/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:44.430125 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a07d0-a4ef-4a12-b825-adaebbf1aa90 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:44.435770 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:44.504635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a07d0-a4ef-4a12-b825-adaebbf1aa90 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:44.509858 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:44.510543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:44.510971 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:44.511299 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] PATH_INFO: `/v3/users/cb254fc8c0294b8387ec8d94c2b523a6` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:44.512600 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb254fc8c0294b8387ec8d94c2b523a6)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:44.514673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:44.526286 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:44.527727 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:44.545169 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6b7ee-6007-45c6-b7b0-c822b8bc109a service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:44.550311 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:44.550916 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:44.551182 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:44.551455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] PATH_INFO: `/v3/users/1e499a55a3b141879719fbc1856d3350` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:44.552627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e499a55a3b141879719fbc1856d3350)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:44.554603 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:44.573228 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb254fc8c0294b8387ec8d94c2b523a6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.588305 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb254fc8c0294b8387ec8d94c2b523a6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.595927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb254fc8c0294b8387ec8d94c2b523a6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.596580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb254fc8c0294b8387ec8d94c2b523a6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.603938 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb254fc8c0294b8387ec8d94c2b523a6'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.608886 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e499a55a3b141879719fbc1856d3350'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.610130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1430/2859] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:44 2022] DELETE /identity/v3/users/cb254fc8c0294b8387ec8d94c2b523a6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:44.620966 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e499a55a3b141879719fbc1856d3350'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.621713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e499a55a3b141879719fbc1856d3350'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.635093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e499a55a3b141879719fbc1856d3350'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.642345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e499a55a3b141879719fbc1856d3350'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.648895 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1430/2860] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:44 2022] DELETE /identity/v3/users/1e499a55a3b141879719fbc1856d3350 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:44.813727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:44.815614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:44.844261 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:44.845672 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:44.857524 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:44.896642 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8ff3-82db-452a-a0f8-9c146dd57804 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:44.926931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:44.927829 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365a659-719b-4585-91c3-9a1a65d74a6a admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:44.933435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:44.934141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:44.935292 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:44.935529 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] PATH_INFO: `/v3/projects/0a514a384742409d86c6cb7e1c10434a` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:44.936710 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a514a384742409d86c6cb7e1c10434a)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:44.938679 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:44.964605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:44.965255 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:44.965534 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:44.965802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] PATH_INFO: `/v3/projects/d8ac9469bb2547e088f9f36378518723` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:44.966937 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ac9469bb2547e088f9f36378518723)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:44.968820 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:44.990924 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a514a384742409d86c6cb7e1c10434a', 'request_id': 'req-828ed162-9b6d-4d9c-9527-a248d2377911'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:44.998427 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a514a384742409d86c6cb7e1c10434a', 'request_id': 'req-828ed162-9b6d-4d9c-9527-a248d2377911'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.004215 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a514a384742409d86c6cb7e1c10434a', 'request_id': 'req-828ed162-9b6d-4d9c-9527-a248d2377911'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.015506 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] The token cache is being invalidate because project 0a514a384742409d86c6cb7e1c10434a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:45.015792 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.016402 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.018092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1431/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:44 2022] DELETE /identity/v3/projects/0a514a384742409d86c6cb7e1c10434a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:45.019722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ac9469bb2547e088f9f36378518723', 'request_id': 'req-50bc376b-84e8-4599-a389-cf1ceb9a89ee'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.027846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ac9469bb2547e088f9f36378518723', 'request_id': 'req-50bc376b-84e8-4599-a389-cf1ceb9a89ee'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.034922 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ac9469bb2547e088f9f36378518723', 'request_id': 'req-50bc376b-84e8-4599-a389-cf1ceb9a89ee'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.047393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] The token cache is being invalidate because project d8ac9469bb2547e088f9f36378518723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:45.047687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.048443 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.050621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1431/2862] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:44 2022] DELETE /identity/v3/projects/d8ac9469bb2547e088f9f36378518723 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:45.054904 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:45.056372 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:45.127134 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ed162-9b6d-4d9c-9527-a248d2377911 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:45.180093 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:45.195237 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:45.195801 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.196077 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.196346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] PATH_INFO: `/v3/users/0d07132322a54ca49d538f66e204d62c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.197758 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d07132322a54ca49d538f66e204d62c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:45.199736 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:45.252162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d07132322a54ca49d538f66e204d62c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.261135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d07132322a54ca49d538f66e204d62c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.261823 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d07132322a54ca49d538f66e204d62c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.274964 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d07132322a54ca49d538f66e204d62c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.282383 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-5745637b-869f-40c1-b5d8-f9e58f8684d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d07132322a54ca49d538f66e204d62c'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.289713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1432/2863] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:45 2022] DELETE /identity/v3/users/0d07132322a54ca49d538f66e204d62c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:45.460567 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:45.462088 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:45.477104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc376b-84e8-4599-a389-cf1ceb9a89ee admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:45.535247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:45.535873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.536182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.536527 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] PATH_INFO: `/v3/projects/ed9a6e779866454fb67917598e48a68a` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.537714 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9a6e779866454fb67917598e48a68a)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:45.539635 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:45.586990 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9a6e779866454fb67917598e48a68a', 'request_id': 'req-aaa5d03c-95ec-402b-96c9-8662c1b163a7'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.594188 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9a6e779866454fb67917598e48a68a', 'request_id': 'req-aaa5d03c-95ec-402b-96c9-8662c1b163a7'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.599418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:45.600609 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9a6e779866454fb67917598e48a68a', 'request_id': 'req-aaa5d03c-95ec-402b-96c9-8662c1b163a7'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.613399 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] The token cache is being invalidate because project ed9a6e779866454fb67917598e48a68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:45.613712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.614362 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-aaa5d03c-95ec-402b-96c9-8662c1b163a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:45.615846 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1432/2864] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:45 2022] DELETE /identity/v3/projects/ed9a6e779866454fb67917598e48a68a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:45.620949 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a98c0-cefd-468e-a9a8-8ddebc29b968 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.621287 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a98c0-cefd-468e-a9a8-8ddebc29b968 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.621562 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a98c0-cefd-468e-a9a8-8ddebc29b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.640680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-f84a98c0-cefd-468e-a9a8-8ddebc29b968 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:45.641907 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-f84a98c0-cefd-468e-a9a8-8ddebc29b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:45.701477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1433/2865] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:45.709796 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38968b8-08e1-431f-a7df-57461269fe63 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.710022 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38968b8-08e1-431f-a7df-57461269fe63 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.710296 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38968b8-08e1-431f-a7df-57461269fe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.730062 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-c38968b8-08e1-431f-a7df-57461269fe63 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:45.731265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-c38968b8-08e1-431f-a7df-57461269fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:45.739114 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1433/2866] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:45.745113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a98c0-cefd-468e-a9a8-8ddebc29b968 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:45.755340 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a98c0-cefd-468e-a9a8-8ddebc29b968 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:45.759840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:45.760428 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.760703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.760971 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.761640 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:08:45.761944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:45.763519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:45.775638 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1434/2867] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:08:45.779959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38968b8-08e1-431f-a7df-57461269fe63 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:45.789559 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38968b8-08e1-431f-a7df-57461269fe63 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:45.794302 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:45.794918 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.795197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.795467 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.796104 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:45.799754 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:45.836680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1434/2868] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:45 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:45.840853 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:45.850830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5b1ae-96d1-4ea0-a9b7-de300495bdfa admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:45.898953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:45.909700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:45.910295 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.910577 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.910850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.911473 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:45.913434 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:45.933813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1435/2869] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:45 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:08:45.937927 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:45.948901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97356971-0259-45e5-9a83-cd33df610afd admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:45.953531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:45.954113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.954384 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.954648 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.955308 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:45.957883 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:45.967773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1435/2870] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:45.971724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:45.981947 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720343-5994-4a4d-bb01-3fb1d4449f2b admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:45.986545 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347915d-8f5a-4240-817b-36a04ace3127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:45.987320 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347915d-8f5a-4240-817b-36a04ace3127 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:45.987601 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347915d-8f5a-4240-817b-36a04ace3127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:45.987877 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347915d-8f5a-4240-817b-36a04ace3127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:45.988635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347915d-8f5a-4240-817b-36a04ace3127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:45.990259 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347915d-8f5a-4240-817b-36a04ace3127 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.001096 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1436/2871] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:46.005700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.015686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ee29c-d9de-48f5-8ee4-c16263a0a4da admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.021121 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.021792 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.022074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.022349 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] PATH_INFO: `/v3/projects/bc9dd2ae294a42bc8cab7138cc505797/users/fb200438156a45e78dc59cb34f16f91e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.036924 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9dd2ae294a42bc8cab7138cc505797, user_id=fb200438156a45e78dc59cb34f16f91e, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.039584 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.052803 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1436/2872] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:46 2022] PUT /identity/v3/projects/bc9dd2ae294a42bc8cab7138cc505797/users/fb200438156a45e78dc59cb34f16f91e/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:46.062835 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f712eda-03d6-48f3-85f8-6b938b4c0a68 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.063120 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f712eda-03d6-48f3-85f8-6b938b4c0a68 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.063387 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f712eda-03d6-48f3-85f8-6b938b4c0a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.092943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5f712eda-03d6-48f3-85f8-6b938b4c0a68 None None] MFA Rules not processed for user `fb200438156a45e78dc59cb34f16f91e`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:46.094222 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5f712eda-03d6-48f3-85f8-6b938b4c0a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:46.157854 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1437/2873] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:46.162315 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.224030 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b9f82-87c0-4cf8-a8f4-41ef90078de8 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.231832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.232440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.232745 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.233018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.233725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.235623 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.263007 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1437/2874] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:46 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:46.267070 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f712eda-03d6-48f3-85f8-6b938b4c0a68 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.278117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f712eda-03d6-48f3-85f8-6b938b4c0a68 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.336519 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.337285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.337569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.337844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.338570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.340481 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.362502 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1438/2875] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:46 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:46.366469 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.377145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241829c7-2f61-4cf3-9b9d-f23682478b07 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.382490 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.383086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.383359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.383627 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.384262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.385879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.397928 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1438/2876] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:46.402249 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.412066 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8daaa-0aa0-4fa5-8934-f7017a2406dd admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.416752 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.417430 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.417713 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.418354 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] PATH_INFO: `/v3/projects/3fdfb5b815804333bba8108cef68f6f1/users/db99b91c65b2422ab6662dd52b746734/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.433768 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdfb5b815804333bba8108cef68f6f1, user_id=db99b91c65b2422ab6662dd52b746734, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.436384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.449507 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1439/2877] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:46 2022] PUT /identity/v3/projects/3fdfb5b815804333bba8108cef68f6f1/users/db99b91c65b2422ab6662dd52b746734/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:46.453491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.463419 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd476-727e-4560-bd9e-c417b521e29e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.521358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91692e16-33d5-47aa-a1eb-c9438ff7e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.521874 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692e16-33d5-47aa-a1eb-c9438ff7e540 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.522145 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692e16-33d5-47aa-a1eb-c9438ff7e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.522407 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692e16-33d5-47aa-a1eb-c9438ff7e540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.523032 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91692e16-33d5-47aa-a1eb-c9438ff7e540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.524612 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91692e16-33d5-47aa-a1eb-c9438ff7e540 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.526594 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:46.539401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1439/2878] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:46.540536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.551472 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3db59f-b89f-491e-a731-7ec2f728c3a0 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.555973 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.556604 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.556882 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.557167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] PATH_INFO: `/v3/projects/3fdfb5b815804333bba8108cef68f6f1/users/db99b91c65b2422ab6662dd52b746734/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.559054 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdfb5b815804333bba8108cef68f6f1, user_id=db99b91c65b2422ab6662dd52b746734, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.561706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.571901 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1440/2879] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:46 2022] PUT /identity/v3/projects/3fdfb5b815804333bba8108cef68f6f1/users/db99b91c65b2422ab6662dd52b746734/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:46.582301 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587255-dd1e-4057-929e-7c7f05a1b4a1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.582580 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587255-dd1e-4057-929e-7c7f05a1b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.582849 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587255-dd1e-4057-929e-7c7f05a1b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.610333 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f5587255-dd1e-4057-929e-7c7f05a1b4a1 None None] MFA Rules not processed for user `db99b91c65b2422ab6662dd52b746734`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:46.611535 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f5587255-dd1e-4057-929e-7c7f05a1b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:46.681056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1440/2880] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:46.691820 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.693548 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:46.709688 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:46.753613 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365f8c-22d7-4a33-beda-cb99795887e8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.757302 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.757900 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.758175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.758445 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.767238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.768700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.777987 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1441/2881] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:46.880363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587255-dd1e-4057-929e-7c7f05a1b4a1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:46.889964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587255-dd1e-4057-929e-7c7f05a1b4a1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:46.894195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff0fc4-8ba9-4de0-bf27-23dc547229d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:46.894789 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff0fc4-8ba9-4de0-bf27-23dc547229d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:46.895067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff0fc4-8ba9-4de0-bf27-23dc547229d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:46.895344 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff0fc4-8ba9-4de0-bf27-23dc547229d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:46.959347 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff0fc4-8ba9-4de0-bf27-23dc547229d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:46.960778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff0fc4-8ba9-4de0-bf27-23dc547229d2 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:46.969741 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1441/2882] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:49.551015 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:49.611067 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a56a5-00d6-40b6-a725-1c24bdd26c04 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:49.616200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:49.616814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:49.617091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:49.617388 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] PATH_INFO: `/v3/users/fb200438156a45e78dc59cb34f16f91e` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:49.618755 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb200438156a45e78dc59cb34f16f91e)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:49.620647 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:49.667850 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb200438156a45e78dc59cb34f16f91e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:49.675898 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb200438156a45e78dc59cb34f16f91e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:49.676509 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb200438156a45e78dc59cb34f16f91e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:49.688409 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb200438156a45e78dc59cb34f16f91e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:49.695804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb200438156a45e78dc59cb34f16f91e'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:49.701588 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1442/2883] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:49 2022] DELETE /identity/v3/users/fb200438156a45e78dc59cb34f16f91e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:49.706350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:49.706832 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:49.706976 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:49.726277 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:49.727479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:49.786334 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1442/2884] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:49.795732 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:49.797144 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:49.837723 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:49.857132 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5148a3-98eb-4b41-a2ce-8a8f50f157f6 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:49.860757 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:49.861386 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:49.861796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:49.862208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:49.871329 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:49.872746 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:49.882275 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1443/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:50.149085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:50.150577 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:50.164434 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce94056-3999-4892-a649-1fcfea990471 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:50.169445 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:50.170075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:50.170351 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:50.170621 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] PATH_INFO: `/v3/projects/bc9dd2ae294a42bc8cab7138cc505797` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:50.171802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9dd2ae294a42bc8cab7138cc505797)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:50.173919 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:50.190839 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=100 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:50.222077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9dd2ae294a42bc8cab7138cc505797', 'request_id': 'req-d3c4129d-d3e9-46e4-9cff-f4de316914e4'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.229326 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9dd2ae294a42bc8cab7138cc505797', 'request_id': 'req-d3c4129d-d3e9-46e4-9cff-f4de316914e4'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.235251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9dd2ae294a42bc8cab7138cc505797', 'request_id': 'req-d3c4129d-d3e9-46e4-9cff-f4de316914e4'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.246738 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] The token cache is being invalidate because project bc9dd2ae294a42bc8cab7138cc505797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:50.247024 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.247655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.249111 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1443/2886] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:50 2022] DELETE /identity/v3/projects/bc9dd2ae294a42bc8cab7138cc505797 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:50.253777 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:50.263339 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d96dbd-e067-486f-ac8e-9b452fbb2d67 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:50.318618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121133e8-029c-444e-956f-7a553875553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:50.319234 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121133e8-029c-444e-956f-7a553875553e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:50.319508 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121133e8-029c-444e-956f-7a553875553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:50.319782 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121133e8-029c-444e-956f-7a553875553e admin admin] PATH_INFO: `/v3/users/db99b91c65b2422ab6662dd52b746734` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:50.320888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121133e8-029c-444e-956f-7a553875553e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db99b91c65b2422ab6662dd52b746734)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:50.322837 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121133e8-029c-444e-956f-7a553875553e admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:50.367218 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-121133e8-029c-444e-956f-7a553875553e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db99b91c65b2422ab6662dd52b746734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.375408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-121133e8-029c-444e-956f-7a553875553e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db99b91c65b2422ab6662dd52b746734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.376011 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-121133e8-029c-444e-956f-7a553875553e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db99b91c65b2422ab6662dd52b746734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.389136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-121133e8-029c-444e-956f-7a553875553e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db99b91c65b2422ab6662dd52b746734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.396621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-121133e8-029c-444e-956f-7a553875553e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db99b91c65b2422ab6662dd52b746734'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.402539 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1444/2887] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:50 2022] DELETE /identity/v3/users/db99b91c65b2422ab6662dd52b746734 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:50.667917 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:50.669647 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:50.684360 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4129d-d3e9-46e4-9cff-f4de316914e4 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:50.742233 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:50.742901 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:50.743120 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:50.743389 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] PATH_INFO: `/v3/projects/3fdfb5b815804333bba8108cef68f6f1` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:50.744747 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdfb5b815804333bba8108cef68f6f1)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:50.746662 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:50.791611 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdfb5b815804333bba8108cef68f6f1', 'request_id': 'req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.799581 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdfb5b815804333bba8108cef68f6f1', 'request_id': 'req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.805440 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdfb5b815804333bba8108cef68f6f1', 'request_id': 'req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.816857 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] The token cache is being invalidate because project 3fdfb5b815804333bba8108cef68f6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:50.817143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.817806 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-6a2626bb-e27c-4830-b7fe-4c6dd40beb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:50.819265 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1444/2888] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:50 2022] DELETE /identity/v3/projects/3fdfb5b815804333bba8108cef68f6f1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:50.824102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb580-f65b-4ebc-ab4d-f0dff786aad9 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:50.824575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb580-f65b-4ebc-ab4d-f0dff786aad9 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:50.824690 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb580-f65b-4ebc-ab4d-f0dff786aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:50.843977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-795eb580-f65b-4ebc-ab4d-f0dff786aad9 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:50.845176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-795eb580-f65b-4ebc-ab4d-f0dff786aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:50.895477 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:50.906273 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1445/2889] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:08:50.914766 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8722-9229-493d-b14e-39b59dd307bc None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:50.915050 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8722-9229-493d-b14e-39b59dd307bc None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:50.915324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8722-9229-493d-b14e-39b59dd307bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:50.935217 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-770d8722-9229-493d-b14e-39b59dd307bc None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:50.936423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-770d8722-9229-493d-b14e-39b59dd307bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:50.944826 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1445/2890] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:50.948923 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb580-f65b-4ebc-ab4d-f0dff786aad9 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:50.958951 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb580-f65b-4ebc-ab4d-f0dff786aad9 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:50.963484 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:50.964068 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:50.964341 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:50.964608 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:50.965281 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:08:50.965575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:50.967235 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:50.979304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1446/2891] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:08:50.983483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d8722-9229-493d-b14e-39b59dd307bc None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:50.993137 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d8722-9229-493d-b14e-39b59dd307bc None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:50.998046 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:50.998626 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:50.998902 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:50.999170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:50.999788 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.001719 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.029558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1446/2892] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:50 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:51.033767 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.043424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954a66-d51d-468d-a17f-557d7222bff7 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.100101 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.100703 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.100984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.101290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.101927 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.103826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.124959 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1447/2893] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:51 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:08:51.129608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.139703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9eba7-0c16-4f56-93f9-c4bf3f649e7e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.145074 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.145700 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.145978 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.146251 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.146887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.148449 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.149711 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:51.160447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1447/2894] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:51.163796 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.173495 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98352cf4-1639-4358-9a5b-f7c2141a4866 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.178162 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d4ba8-a232-4be7-a162-4008dc664263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.178745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4ba8-a232-4be7-a162-4008dc664263 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.179114 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4ba8-a232-4be7-a162-4008dc664263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.179290 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4ba8-a232-4be7-a162-4008dc664263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.180118 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d4ba8-a232-4be7-a162-4008dc664263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.181735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d4ba8-a232-4be7-a162-4008dc664263 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.192896 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1448/2895] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:51.197295 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.208131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49036dd3-9d16-4cf3-af20-7268aae941b3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.212773 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.213456 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.213735 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.214011 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] PATH_INFO: `/v3/projects/5e70a24a8641457e9afd574d95d3d645/users/9b6f1b62157b4afa99fbba7dca492e00/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.229556 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e70a24a8641457e9afd574d95d3d645, user_id=9b6f1b62157b4afa99fbba7dca492e00, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.232184 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.245409 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1448/2896] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:51 2022] PUT /identity/v3/projects/5e70a24a8641457e9afd574d95d3d645/users/9b6f1b62157b4afa99fbba7dca492e00/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:51.256593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0995750-1fb5-479b-b67c-a506ad750a77 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.256874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0995750-1fb5-479b-b67c-a506ad750a77 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.257141 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0995750-1fb5-479b-b67c-a506ad750a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.284868 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-c0995750-1fb5-479b-b67c-a506ad750a77 None None] MFA Rules not processed for user `9b6f1b62157b4afa99fbba7dca492e00`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:51.286092 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c0995750-1fb5-479b-b67c-a506ad750a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:51.349532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1449/2897] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:51.354056 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.415644 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fb864-f835-4f8e-8790-481cb10de177 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.420185 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.420776 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.421053 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.421350 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.421974 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.423848 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.450701 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1449/2898] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:51 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:51.454840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0995750-1fb5-479b-b67c-a506ad750a77 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.465363 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0995750-1fb5-479b-b67c-a506ad750a77 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.513981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:51.524593 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.525220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.525503 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.525776 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.526408 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.528298 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.549793 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1450/2899] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:51 2022] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:08:51.554009 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.564204 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631158-882f-4286-864c-d009b6d32702 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.569703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.570285 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.570558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.570822 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.571450 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.573094 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.583491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1450/2900] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:51.587760 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.597654 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85fac-5e5a-43ba-8237-a04a96548661 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.602135 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.602770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.603043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.603312 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] PATH_INFO: `/v3/projects/727f07b42363415da0f5991128364539/users/c1433664910d43c6ba9650c93e574e0f/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.618063 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=727f07b42363415da0f5991128364539, user_id=c1433664910d43c6ba9650c93e574e0f, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.620941 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.634814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1451/2901] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:51 2022] PUT /identity/v3/projects/727f07b42363415da0f5991128364539/users/c1433664910d43c6ba9650c93e574e0f/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:51.638824 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.649173 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78111cf8-7930-481b-98a3-63640908fe79 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.710025 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c8539-7bab-4bcb-9cdf-e5404c70caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.710550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c8539-7bab-4bcb-9cdf-e5404c70caed admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.710823 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c8539-7bab-4bcb-9cdf-e5404c70caed admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.711089 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c8539-7bab-4bcb-9cdf-e5404c70caed admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.711718 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c8539-7bab-4bcb-9cdf-e5404c70caed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.713306 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c8539-7bab-4bcb-9cdf-e5404c70caed admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.723683 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1451/2902] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:51.727874 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.738676 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f4e62-aeee-4874-ba56-b9b570fede9f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.743266 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.744161 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.744461 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.744733 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] PATH_INFO: `/v3/projects/727f07b42363415da0f5991128364539/users/c1433664910d43c6ba9650c93e574e0f/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.746680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] RBAC: Authorizing `identity:create_grant(project_id=727f07b42363415da0f5991128364539, user_id=c1433664910d43c6ba9650c93e574e0f, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.749301 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.759326 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1452/2903] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:51 2022] PUT /identity/v3/projects/727f07b42363415da0f5991128364539/users/c1433664910d43c6ba9650c93e574e0f/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:51.769439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2a93e-2a0b-4e73-8aed-947ca700fa33 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.769903 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2a93e-2a0b-4e73-8aed-947ca700fa33 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.770000 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2a93e-2a0b-4e73-8aed-947ca700fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.798263 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-6db2a93e-2a0b-4e73-8aed-947ca700fa33 None None] MFA Rules not processed for user `c1433664910d43c6ba9650c93e574e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:51.800141 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-6db2a93e-2a0b-4e73-8aed-947ca700fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:51.829737 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:51.869892 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1452/2904] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:51.880567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:51.882285 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:51.938252 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7da0-1544-419c-a5d7-38757dc3245f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:51.941864 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:51.942455 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:51.942728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:51.942996 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:51.951721 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:51.953173 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:51.963064 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1453/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:52.110124 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2a93e-2a0b-4e73-8aed-947ca700fa33 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:52.120096 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2a93e-2a0b-4e73-8aed-947ca700fa33 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:52.123565 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac52f-a5e7-4c42-a10f-e79cc2a08bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82e9cce21e2452ca7977b828a137c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:52.124147 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac52f-a5e7-4c42-a10f-e79cc2a08bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:52.124417 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac52f-a5e7-4c42-a10f-e79cc2a08bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:52.124680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac52f-a5e7-4c42-a10f-e79cc2a08bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:52.180330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac52f-a5e7-4c42-a10f-e79cc2a08bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:52.181761 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac52f-a5e7-4c42-a10f-e79cc2a08bd1 service cinder] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:52.190704 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1453/2906] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:57.444487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:57.507085 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d3cb0-6f41-4022-aeca-1ae84233e755 service cinder] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:57.511922 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:57.512558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:57.512857 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:57.513123 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] PATH_INFO: `/v3/users/9b6f1b62157b4afa99fbba7dca492e00` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:57.514338 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6f1b62157b4afa99fbba7dca492e00)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:57.516265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:57.564394 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6f1b62157b4afa99fbba7dca492e00'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:57.567136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:57.572006 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6f1b62157b4afa99fbba7dca492e00'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:57.572815 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6f1b62157b4afa99fbba7dca492e00'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:57.586220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6f1b62157b4afa99fbba7dca492e00'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:57.593217 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6f1b62157b4afa99fbba7dca492e00'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:57.599674 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1454/2907] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:57 2022] DELETE /identity/v3/users/9b6f1b62157b4afa99fbba7dca492e00 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:57.604310 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c228-6ca5-4881-982f-b164834da120 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:57.604787 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c228-6ca5-4881-982f-b164834da120 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:57.604887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c228-6ca5-4881-982f-b164834da120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:57.623645 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-f467c228-6ca5-4881-982f-b164834da120 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:57.624876 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f467c228-6ca5-4881-982f-b164834da120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:57.685083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1454/2908] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:57.695367 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:57.696814 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:57.752269 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be201db-67a4-4e38-99b5-94a703e1bfcc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:57.756745 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:57.757382 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:57.757657 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:57.757925 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:57.766885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:57.769019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:57.778470 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1455/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:08:58.055142 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467c228-6ca5-4881-982f-b164834da120 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:58.056686 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-f467c228-6ca5-4881-982f-b164834da120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:58.071812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467c228-6ca5-4881-982f-b164834da120 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:58.077041 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:58.077879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:58.078170 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:58.078452 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] PATH_INFO: `/v3/projects/5e70a24a8641457e9afd574d95d3d645` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:58.079725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e70a24a8641457e9afd574d95d3d645)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:58.082542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:58.130554 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e70a24a8641457e9afd574d95d3d645', 'request_id': 'req-d4e5fcf0-4327-4307-a90a-2c1601fd931e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.137814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e70a24a8641457e9afd574d95d3d645', 'request_id': 'req-d4e5fcf0-4327-4307-a90a-2c1601fd931e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.141828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:58.144882 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e70a24a8641457e9afd574d95d3d645', 'request_id': 'req-d4e5fcf0-4327-4307-a90a-2c1601fd931e'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.157798 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] The token cache is being invalidate because project 5e70a24a8641457e9afd574d95d3d645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:58.158085 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.158716 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.160413 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1455/2910] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:58 2022] DELETE /identity/v3/projects/5e70a24a8641457e9afd574d95d3d645 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:58.164487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:58.173954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af4b1-0b16-4e9c-b4bf-8e1e74b06551 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:58.229174 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:58.229804 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:58.230078 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:58.230352 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] PATH_INFO: `/v3/users/c1433664910d43c6ba9650c93e574e0f` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:58.231460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1433664910d43c6ba9650c93e574e0f)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:58.233381 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:58.277669 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1433664910d43c6ba9650c93e574e0f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.284826 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1433664910d43c6ba9650c93e574e0f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.285476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1433664910d43c6ba9650c93e574e0f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.297840 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1433664910d43c6ba9650c93e574e0f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.298917 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:58.307043 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-4433f8da-2d50-4753-82fd-31c7bf98abc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1433664910d43c6ba9650c93e574e0f'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.313724 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1456/2911] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:08:58 2022] DELETE /identity/v3/users/c1433664910d43c6ba9650c93e574e0f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:58.590607 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:58.592083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:58.607321 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5fcf0-4327-4307-a90a-2c1601fd931e admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:58.665724 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:58.666359 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:58.666687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:58.666963 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] PATH_INFO: `/v3/projects/727f07b42363415da0f5991128364539` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:58.668115 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727f07b42363415da0f5991128364539)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:58.670038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:58.715498 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727f07b42363415da0f5991128364539', 'request_id': 'req-89d2cdeb-14fa-4393-afc9-286d23b00842'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.722712 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727f07b42363415da0f5991128364539', 'request_id': 'req-89d2cdeb-14fa-4393-afc9-286d23b00842'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.728175 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727f07b42363415da0f5991128364539', 'request_id': 'req-89d2cdeb-14fa-4393-afc9-286d23b00842'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.739725 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] The token cache is being invalidate because project 727f07b42363415da0f5991128364539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:08:58.740006 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.740624 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-89d2cdeb-14fa-4393-afc9-286d23b00842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:08:58.742098 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1456/2912] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:08:58 2022] DELETE /identity/v3/projects/727f07b42363415da0f5991128364539 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:08:58.747139 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dbea8-5126-4595-a145-cbbae7e7a87c None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:58.747607 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dbea8-5126-4595-a145-cbbae7e7a87c None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:58.747706 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dbea8-5126-4595-a145-cbbae7e7a87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:58.766934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5e1dbea8-5126-4595-a145-cbbae7e7a87c None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:58.768106 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5e1dbea8-5126-4595-a145-cbbae7e7a87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:58.826889 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1457/2913] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:58.889084 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2bd6-a364-49b5-961a-c75da6fd9e58 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:58.889304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2bd6-a364-49b5-961a-c75da6fd9e58 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:58.889591 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2bd6-a364-49b5-961a-c75da6fd9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:58.911778 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-87ac2bd6-a364-49b5-961a-c75da6fd9e58 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:58.913020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-87ac2bd6-a364-49b5-961a-c75da6fd9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:58.920888 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1457/2914] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:58.925415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dbea8-5126-4595-a145-cbbae7e7a87c None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:58.935187 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dbea8-5126-4595-a145-cbbae7e7a87c None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:58.939773 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:58.940385 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:58.940664 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:58.940936 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:58.941617 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:08:58.941918 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:58.943535 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:58.954891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1458/2915] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:08:58.959652 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2bd6-a364-49b5-961a-c75da6fd9e58 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:58.968834 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2bd6-a364-49b5-961a-c75da6fd9e58 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:58.974260 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:58.974851 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:58.975130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:58.975400 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:58.976037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:58.977949 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:59.004508 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1458/2916] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:08:58 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:08:59.008600 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:59.018816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f5c77-af3b-4f3a-bbc5-c9e2f0b1aeaa admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:59.074019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:59.074625 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:59.074934 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:59.075255 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:59.075891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:59.077810 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:59.099893 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1459/2917] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:08:59 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:08:59.104015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:59.114252 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61861df-ba64-45fe-9e0e-78f483a2ea91 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:59.120358 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:59.120964 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:59.121278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:59.121550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:59.122193 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:59.123771 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:59.134540 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1459/2918] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:59.138530 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:59.149113 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ad785-c44b-405a-9225-0c8a84cae3d2 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:59.153594 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c577c-661d-4f8d-b05f-d9ecd8ba849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:59.154175 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c577c-661d-4f8d-b05f-d9ecd8ba849a admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:59.154444 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c577c-661d-4f8d-b05f-d9ecd8ba849a admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:59.154708 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c577c-661d-4f8d-b05f-d9ecd8ba849a admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:59.155336 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c577c-661d-4f8d-b05f-d9ecd8ba849a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:59.156888 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c577c-661d-4f8d-b05f-d9ecd8ba849a admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:59.167954 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1460/2919] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:08:59.172016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:59.181772 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ef20c-b615-48b4-8867-719d54f96833 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:59.186322 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:59.186959 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:59.187224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:59.187493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] PATH_INFO: `/v3/projects/6bdb1e49d7f1470c93a41f4cf818b023/users/fcb53a8d36404764ab84b0eefef37ef7/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:59.202258 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdb1e49d7f1470c93a41f4cf818b023, user_id=fcb53a8d36404764ab84b0eefef37ef7, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:59.204873 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:59.217945 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1460/2920] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:08:59 2022] PUT /identity/v3/projects/6bdb1e49d7f1470c93a41f4cf818b023/users/fcb53a8d36404764ab84b0eefef37ef7/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 12:08:59.228018 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50717e5a-7c78-4bf4-a020-498ce12e68ad None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:59.228299 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50717e5a-7c78-4bf4-a020-498ce12e68ad None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:59.228572 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50717e5a-7c78-4bf4-a020-498ce12e68ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:59.256487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-50717e5a-7c78-4bf4-a020-498ce12e68ad None None] MFA Rules not processed for user `fcb53a8d36404764ab84b0eefef37ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:08:59.257851 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-50717e5a-7c78-4bf4-a020-498ce12e68ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:59.300696 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:59.321986 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1461/2921] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:08:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:08:59.334655 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:08:59.336318 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:08:59.354809 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:59.415442 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c407285-93e3-4043-a149-cbf9c27ace0b admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:08:59.419039 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3177b7-8fc1-4f09-b572-bb809a299cb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f951f4e6a8e5407580ec1ead59fdeec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:08:59.419628 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3177b7-8fc1-4f09-b572-bb809a299cb7 service glance] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:08:59.419930 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3177b7-8fc1-4f09-b572-bb809a299cb7 service glance] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:08:59.420197 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3177b7-8fc1-4f09-b572-bb809a299cb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:08:59.428816 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3177b7-8fc1-4f09-b572-bb809a299cb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:08:59.430267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3177b7-8fc1-4f09-b572-bb809a299cb7 service glance] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:08:59.438880 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1461/2922] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:08:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:09:09.319117 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=7 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:09.435028 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=28 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:27.557637 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50717e5a-7c78-4bf4-a020-498ce12e68ad None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:27.620324 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50717e5a-7c78-4bf4-a020-498ce12e68ad None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:27.624784 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:27.625429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:27.625704 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:27.625967 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] PATH_INFO: `/v3/users/fcb53a8d36404764ab84b0eefef37ef7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:27.627057 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb53a8d36404764ab84b0eefef37ef7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:27.628944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:27.677584 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb53a8d36404764ab84b0eefef37ef7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:27.685587 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb53a8d36404764ab84b0eefef37ef7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:27.686238 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb53a8d36404764ab84b0eefef37ef7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:27.698247 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb53a8d36404764ab84b0eefef37ef7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:27.705487 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb53a8d36404764ab84b0eefef37ef7'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:27.711453 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1462/2923] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:09:27 2022] DELETE /identity/v3/users/fcb53a8d36404764ab84b0eefef37ef7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:09:27.715961 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339e60-1b53-4729-9933-529109563e9b None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:27.716425 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339e60-1b53-4729-9933-529109563e9b None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:27.716547 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339e60-1b53-4729-9933-529109563e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:27.736742 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-09339e60-1b53-4729-9933-529109563e9b None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:27.737969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-09339e60-1b53-4729-9933-529109563e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:27.796785 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1462/2924] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:27.807100 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:27.808480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:27.864480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b71c-31b8-480e-9db8-80aed1ed2671 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:27.869040 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593357e9-2b1d-4945-be4a-1bb829d3a26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:27.869726 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593357e9-2b1d-4945-be4a-1bb829d3a26c service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:27.870012 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593357e9-2b1d-4945-be4a-1bb829d3a26c service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:27.870282 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593357e9-2b1d-4945-be4a-1bb829d3a26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:27.879401 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593357e9-2b1d-4945-be4a-1bb829d3a26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:27.880812 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593357e9-2b1d-4945-be4a-1bb829d3a26c service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:27.890319 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1463/2925] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:09:28.157393 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339e60-1b53-4729-9933-529109563e9b None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.158835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-09339e60-1b53-4729-9933-529109563e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:28.172606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339e60-1b53-4729-9933-529109563e9b None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.177550 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.178195 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.179083 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.179368 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] PATH_INFO: `/v3/projects/6bdb1e49d7f1470c93a41f4cf818b023` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.180687 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdb1e49d7f1470c93a41f4cf818b023)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.182654 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.231513 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdb1e49d7f1470c93a41f4cf818b023', 'request_id': 'req-31804379-5b6b-40f6-9f36-b04acf927be2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:28.238956 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdb1e49d7f1470c93a41f4cf818b023', 'request_id': 'req-31804379-5b6b-40f6-9f36-b04acf927be2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:28.245588 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdb1e49d7f1470c93a41f4cf818b023', 'request_id': 'req-31804379-5b6b-40f6-9f36-b04acf927be2'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:28.256561 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] The token cache is being invalidate because project 6bdb1e49d7f1470c93a41f4cf818b023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:09:28.256847 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:28.257730 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-31804379-5b6b-40f6-9f36-b04acf927be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:09:28.259044 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1463/2926] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:09:28 2022] DELETE /identity/v3/projects/6bdb1e49d7f1470c93a41f4cf818b023 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:09:28.263894 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec47d-832c-42fc-b6eb-0dc1b5280204 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.264208 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec47d-832c-42fc-b6eb-0dc1b5280204 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.264510 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec47d-832c-42fc-b6eb-0dc1b5280204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.284346 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-b99ec47d-832c-42fc-b6eb-0dc1b5280204 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:28.285621 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-b99ec47d-832c-42fc-b6eb-0dc1b5280204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:28.303193 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:28.348652 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1464/2927] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:28.357908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0651-94cf-4a95-bae0-b98801b64ac1 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.358223 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0651-94cf-4a95-bae0-b98801b64ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.358524 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0651-94cf-4a95-bae0-b98801b64ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.378479 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-4b3a0651-94cf-4a95-bae0-b98801b64ac1 None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:28.379673 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4b3a0651-94cf-4a95-bae0-b98801b64ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:28.388200 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1464/2928] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:28.392264 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ec47d-832c-42fc-b6eb-0dc1b5280204 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.402450 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ec47d-832c-42fc-b6eb-0dc1b5280204 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.407001 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.407591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.407871 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.408145 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.408786 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 12:09:28.409086 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.410700 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.422019 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1465/2929] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Sep 19 12:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 12:09:28.426162 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0651-94cf-4a95-bae0-b98801b64ac1 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.435514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0651-94cf-4a95-bae0-b98801b64ac1 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.440077 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.440658 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.440931 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.441224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.441838 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.443732 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.473812 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1465/2930] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:09:28 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:09:28.478523 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.488274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8af8-9f19-459f-8478-bbcbcc00b9a8 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.545342 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.545935 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.546211 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.546480 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.547102 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.548980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.570680 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1466/2931] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:09:28 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:09:28.574925 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.585242 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a691-63fe-4416-a7d4-39868e12cce3 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.590073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.590663 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.590941 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.591213 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.591871 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.593477 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.604037 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1466/2932] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:09:28.607785 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.618424 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e4cf-b96e-4f45-9301-b27fc0f472df admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.623002 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc32b82-3fd0-4520-889a-2ad4d2d8aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.623586 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32b82-3fd0-4520-889a-2ad4d2d8aa57 admin admin] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.623981 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32b82-3fd0-4520-889a-2ad4d2d8aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.624192 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32b82-3fd0-4520-889a-2ad4d2d8aa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.624953 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc32b82-3fd0-4520-889a-2ad4d2d8aa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.626626 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc32b82-3fd0-4520-889a-2ad4d2d8aa57 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.637172 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1467/2933] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:09:28.641259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.651179 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f26dcc-6ad1-495c-b5eb-e8d4034f4245 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.655887 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.656538 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.656814 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.657086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] PATH_INFO: `/v3/projects/1b589dd6bdb34bce931e5416e7f64a0c/users/50c594b450b04e54a22ecf5947116745/roles/3af5b9ea5a3e4431b95b13af8fbfb03e` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.672493 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b589dd6bdb34bce931e5416e7f64a0c, user_id=50c594b450b04e54a22ecf5947116745, role_id=3af5b9ea5a3e4431b95b13af8fbfb03e)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.675143 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.688828 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1467/2934] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:09:28 2022] PUT /identity/v3/projects/1b589dd6bdb34bce931e5416e7f64a0c/users/50c594b450b04e54a22ecf5947116745/roles/3af5b9ea5a3e4431b95b13af8fbfb03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:09:28.693897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50295-5bad-4db4-9232-313f0692f68e None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.694183 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50295-5bad-4db4-9232-313f0692f68e None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.694456 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50295-5bad-4db4-9232-313f0692f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.713569 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-5af50295-5bad-4db4-9232-313f0692f68e None None] MFA Rules not processed for user `52cfabda91074225ac5581142c451796`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:28.714770 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5af50295-5bad-4db4-9232-313f0692f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:28.774155 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1468/2935] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:28.783914 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:28.785760 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:28.808802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:28.845018 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59af44-f766-43d7-a5f8-89d404ba5c09 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:28.848699 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:28.849330 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:28.849608 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:28.849879 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:28.859630 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:28.860981 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:28.870703 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1468/2936] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:09:32.824512 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9c75-f313-4eff-a683-71afcb1f17e3 None None] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:32.824993 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9c75-f313-4eff-a683-71afcb1f17e3 None None] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:32.825103 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9c75-f313-4eff-a683-71afcb1f17e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:32.860345 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.auth.core [None req-342f9c75-f313-4eff-a683-71afcb1f17e3 None None] MFA Rules not processed for user `50c594b450b04e54a22ecf5947116745`. Rule list: `[]` (Enabled: `True`). {{(pid=81419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:32.861581 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-342f9c75-f313-4eff-a683-71afcb1f17e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:32.879754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:32.933832 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1469/2937] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:09:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 12:09:32.938418 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:32.948371 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e925e5-9780-4a80-a52f-dc6ec7b73e8f service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:32.952993 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:32.953629 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:32.953905 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:32.954176 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:32.954844 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:32.956727 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:32.985896 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1469/2938] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Sep 19 12:09:32 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 12:09:32.989839 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f9c75-f313-4eff-a683-71afcb1f17e3 None None] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:33.002265 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f9c75-f313-4eff-a683-71afcb1f17e3 None None] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:33.062816 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:33.063426 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:33.063740 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:33.063989 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] PATH_INFO: `/v3/users` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:33.064629 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:33.066565 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:33.091167 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1470/2939] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Sep 19 12:09:32 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 12:09:33.095091 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:33.106020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11adf-7367-4bd3-baea-ae98976cbe9f admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:33.110799 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:33.111401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:33.111678 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:33.112026 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:33.112589 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:33.114290 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:33.126423 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1470/2940] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:09:33.130869 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:33.141926 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3b76c-3133-42e6-8889-1a7f53754b27 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:33.149591 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:33.150274 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:33.150554 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:33.150830 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] PATH_INFO: `/v3/projects/d129ce772e70411c93fbd85a6e8387a7/users/94b25ceb4d44443a9e722c7ea7fb6956/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:33.167299 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d129ce772e70411c93fbd85a6e8387a7, user_id=94b25ceb4d44443a9e722c7ea7fb6956, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:33.170010 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:33.184304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1471/2941] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:09:33 2022] PUT /identity/v3/projects/d129ce772e70411c93fbd85a6e8387a7/users/94b25ceb4d44443a9e722c7ea7fb6956/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:09:33.188224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:33.198985 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c07ba-488d-48c6-a117-03f3299afa14 admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:33.257222 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5127b1-e700-469f-b3a7-fba91f25001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:33.257895 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5127b1-e700-469f-b3a7-fba91f25001b admin admin] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:33.258172 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5127b1-e700-469f-b3a7-fba91f25001b admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:33.258441 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5127b1-e700-469f-b3a7-fba91f25001b admin admin] PATH_INFO: `/v3/roles` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:33.259071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5127b1-e700-469f-b3a7-fba91f25001b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:33.260636 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5127b1-e700-469f-b3a7-fba91f25001b admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:33.270106 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1471/2942] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Sep 19 12:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 12:09:33.274914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:33.285377 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770165-aa2c-48a9-a736-02438474181f admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:33.290687 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:33.291331 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] REQUEST_METHOD: `PUT` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:33.291610 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:33.291885 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] PATH_INFO: `/v3/projects/d129ce772e70411c93fbd85a6e8387a7/users/94b25ceb4d44443a9e722c7ea7fb6956/roles/f473d5477c1c48b2ad4ee9d4136deeaf` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:33.293813 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d129ce772e70411c93fbd85a6e8387a7, user_id=94b25ceb4d44443a9e722c7ea7fb6956, role_id=f473d5477c1c48b2ad4ee9d4136deeaf)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:33.296435 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:33.306749 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1472/2943] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Sep 19 12:09:33 2022] PUT /identity/v3/projects/d129ce772e70411c93fbd85a6e8387a7/users/94b25ceb4d44443a9e722c7ea7fb6956/roles/f473d5477c1c48b2ad4ee9d4136deeaf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:09:37.876865 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf75c68-1725-456c-8dce-f508f80ca1d7 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:37.877470 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf75c68-1725-456c-8dce-f508f80ca1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:37.877722 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf75c68-1725-456c-8dce-f508f80ca1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:37.916345 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-1bf75c68-1725-456c-8dce-f508f80ca1d7 None None] MFA Rules not processed for user `94b25ceb4d44443a9e722c7ea7fb6956`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:37.918590 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1bf75c68-1725-456c-8dce-f508f80ca1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:38.015412 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1472/2944] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:38.032220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:38.035404 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:38.129558 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16d1ec-838d-4d3a-a772-1b222e533acc admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:38.137091 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:38.137878 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:38.138225 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:38.138567 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:38.144627 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:38.220753 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:38.222992 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:38.235180 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1473/2945] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:09:39.237043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c8b5-3f49-4682-9944-2ae2feb44ae3 None None] REQUEST_METHOD: `POST` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:39.237542 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c8b5-3f49-4682-9944-2ae2feb44ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:39.237638 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c8b5-3f49-4682-9944-2ae2feb44ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:39.256835 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.auth.core [None req-ac97c8b5-3f49-4682-9944-2ae2feb44ae3 None None] MFA Rules not processed for user `50c594b450b04e54a22ecf5947116745`. Rule list: `[]` (Enabled: `True`). {{(pid=81418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 12:09:39.258150 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-ac97c8b5-3f49-4682-9944-2ae2feb44ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:39.265015 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1473/2946] 10.222.0.42 () {58 vars in 958 bytes} [Mon Sep 19 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 12:09:48.230224 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=24 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:49.251401 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:55.743528 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:09:55.745027 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:55.814754 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bee1bf-169a-4d7e-a49b-a00405e991ab service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:09:55.819943 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:09:55.820618 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:09:55.820897 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:09:55.821256 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:09:55.823023 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:09:55.834384 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:09:55.836735 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:09:55.846597 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1474/2947] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:09:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:05.842304 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=32 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:07.500680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97c8b5-3f49-4682-9944-2ae2feb44ae3 None None] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:10:07.557073 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97c8b5-3f49-4682-9944-2ae2feb44ae3 None None] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:10:07.560685 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:10:07.561324 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:10:07.561605 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:10:07.561877 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:10:07.571311 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:10:07.573075 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:10:07.582606 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1474/2948] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:10:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:10:17.578437 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=26 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:06.562330 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:06.563775 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:06.575476 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380e5f7-8e18-4289-b8e0-8ddc2b0b3a0a service placement] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:06.579007 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:06.579616 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:06.579891 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:06.580157 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:06.581778 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:06.591258 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:06.592731 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:06.600471 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1475/2949] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:16.596955 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:23.458774 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:23.468086 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca787ea5-2f03-4ab0-9c26-7b5eb849c3aa service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:23.471680 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:23.472262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:23.472531 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:23.472819 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:23.474521 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:23.489593 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:23.491439 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:23.504239 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1475/2950] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:24.691200 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:24.699920 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d5846-752d-4585-9a78-ff528f4970dc service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:24.703543 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:24.704179 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:24.704458 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:24.704728 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:24.706460 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:24.720546 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:24.721977 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:24.733344 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1476/2951] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:33.499272 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=6 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:34.727842 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:36.802969 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:36.812336 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c27c-17ec-49e2-a865-b4928e21cdf0 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:36.816146 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:36.816764 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:36.817040 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:36.817363 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:36.819058 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:36.830159 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:36.831558 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:36.840734 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1476/2952] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:37.954985 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:37.963681 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e171588-2a0d-4804-967f-ac33674bcb19 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:37.967944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:37.968526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:37.968802 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:37.969073 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:37.970788 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:37.983980 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:37.985415 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:37.996783 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1477/2953] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:38.084983 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:12:38.098113 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116fa1-7e5d-4aca-9d4d-b1ac4a9d4b27 service neutron] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:12:38.103071 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:12:38.103670 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:12:38.103950 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:12:38.104224 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:12:38.106016 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:12:38.118130 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:12:38.119693 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:12:38.133491 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1477/2954] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:12:47.991465 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=6 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:48.128908 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=12 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:21.576590 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:21.628803 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066506e-f11d-4d69-99ad-5ac564f839aa service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:21.634482 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84d136bca97e446a888c1b51a5b761a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:21.635148 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:21.635489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:21.635844 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:21.637738 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:21.673956 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:21.675526 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:21.687209 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1478/2955] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:28.435248 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:28.437462 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:28.527837 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574b915-3f4b-47ea-917d-ee8ff0c77ef9 service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:28.529489 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:28.534103 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:28.534947 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:28.535256 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:28.535483 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:28.537278 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:28.539872 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66765abe-51cb-4d64-b13f-885bbed743a5 service nova] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:28.543429 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd84265ba2619438485db9a18f94c87aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:28.544021 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] REQUEST_METHOD: `GET` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:28.544300 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:28.544575 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:28.549438 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:28.551020 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:28.561899 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1478/2956] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:14:28.609861 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:28.611291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:28.621136 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1479/2957] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 12:14:31.792240 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:31.804815 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae168-ff21-4617-bbf7-df93120e7a5f service placement] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:31.809481 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:31.810110 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:31.810383 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:31.811447 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] PATH_INFO: `/v3/users/50c594b450b04e54a22ecf5947116745` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:31.812802 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c594b450b04e54a22ecf5947116745)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:31.814753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:31.865797 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c594b450b04e54a22ecf5947116745'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:31.879514 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c594b450b04e54a22ecf5947116745'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:31.889292 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c594b450b04e54a22ecf5947116745'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:31.890008 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c594b450b04e54a22ecf5947116745'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:31.897706 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c594b450b04e54a22ecf5947116745'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:31.904913 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1479/2958] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:31 2022] DELETE /identity/v3/users/50c594b450b04e54a22ecf5947116745 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:32.074422 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:32.086729 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b231-56a0-41c8-89f9-6c67cae06457 service neutron] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:32.146359 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:32.146984 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:32.147260 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:32.147532 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] PATH_INFO: `/v3/projects/1b589dd6bdb34bce931e5416e7f64a0c` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:32.148635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b589dd6bdb34bce931e5416e7f64a0c)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:32.150536 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:32.181914 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:32.197176 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b589dd6bdb34bce931e5416e7f64a0c', 'request_id': 'req-6cc41742-3bdf-4566-9be1-1f9d668481c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.204658 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b589dd6bdb34bce931e5416e7f64a0c', 'request_id': 'req-6cc41742-3bdf-4566-9be1-1f9d668481c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.210360 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b589dd6bdb34bce931e5416e7f64a0c', 'request_id': 'req-6cc41742-3bdf-4566-9be1-1f9d668481c3'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.221847 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] The token cache is being invalidate because project 1b589dd6bdb34bce931e5416e7f64a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:32.222129 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.222756 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.224220 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1480/2959] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:32 2022] DELETE /identity/v3/projects/1b589dd6bdb34bce931e5416e7f64a0c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:32.228182 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:32.229618 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:32.243164 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dbc86-5157-4abf-9e30-cbfc2ea4924c admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:32.299446 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:32.299995 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:32.300273 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:32.300543 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] PATH_INFO: `/v3/users/94b25ceb4d44443a9e722c7ea7fb6956` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:32.301688 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b25ceb4d44443a9e722c7ea7fb6956)` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:32.303614 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:32.315897 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:32.350910 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b25ceb4d44443a9e722c7ea7fb6956'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.363566 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b25ceb4d44443a9e722c7ea7fb6956'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.371043 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b25ceb4d44443a9e722c7ea7fb6956'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.371674 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b25ceb4d44443a9e722c7ea7fb6956'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.379284 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.notifications [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b25ceb4d44443a9e722c7ea7fb6956'} {{(pid=81418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.385038 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1480/2960] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Sep 19 12:14:32 2022] DELETE /identity/v3/users/94b25ceb4d44443a9e722c7ea7fb6956 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:32.555074 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Authenticating user token {{(pid=81419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:14:32.556491 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.fernet_utils [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:14:32.570004 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc41742-3bdf-4566-9be1-1f9d668481c3 admin admin] Validating token access rules against request {{(pid=81419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:14:32.628635 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cfabda91074225ac5581142c451796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ebed357f0fb4f07ab3944407cd5ccdc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:14:32.629291 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:14:32.629570 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:14:32.629841 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] PATH_INFO: `/v3/projects/d129ce772e70411c93fbd85a6e8387a7` {{(pid=81419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:14:32.630939 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d129ce772e70411c93fbd85a6e8387a7)` {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:14:32.632827 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] RBAC: Authorization granted {{(pid=81419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:14:32.678513 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd129ce772e70411c93fbd85a6e8387a7', 'request_id': 'req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.686725 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd129ce772e70411c93fbd85a6e8387a7', 'request_id': 'req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.692653 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd129ce772e70411c93fbd85a6e8387a7', 'request_id': 'req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf'} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.704944 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] The token cache is being invalidate because project d129ce772e70411c93fbd85a6e8387a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 12:14:32.705280 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.705910 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG keystone.notifications [None req-a18ee97c-1619-499c-8e8d-8df9a39e9bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 12:14:32.707413 dv-cinder-858293-1-smb devstack@keystone.service[81419]: [pid: 81419|app: 0|req: 1481/2961] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Sep 19 12:14:32 2022] DELETE /identity/v3/projects/d129ce772e70411c93fbd85a6e8387a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 12:14:42.381659 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:42.701374 dv-cinder-858293-1-smb devstack@keystone.service[81419]: DEBUG dbcounter [-] [81419] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:08.313247 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Authenticating user token {{(pid=81418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 12:15:08.315262 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:08.404259 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3360e7-5242-4c82-b844-82ad12b484ba admin admin] Validating token access rules against request {{(pid=81418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 12:15:08.463131 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafae80-ac38-4cda-b4bd-5d8a6526f80d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9135818040417292f1f2bcb588a105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145ac7c6b0604395a2d42e23e27404b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 12:15:08.463753 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafae80-ac38-4cda-b4bd-5d8a6526f80d service placement] REQUEST_METHOD: `GET` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 12:15:08.464033 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafae80-ac38-4cda-b4bd-5d8a6526f80d service placement] SCRIPT_NAME: `/identity` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 12:15:08.464304 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafae80-ac38-4cda-b4bd-5d8a6526f80d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 12:15:08.466067 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.fernet_utils [None req-aaafae80-ac38-4cda-b4bd-5d8a6526f80d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 12:15:08.477138 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafae80-ac38-4cda-b4bd-5d8a6526f80d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 12:15:08.478729 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafae80-ac38-4cda-b4bd-5d8a6526f80d service placement] RBAC: Authorization granted {{(pid=81418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 12:15:08.489116 dv-cinder-858293-1-smb devstack@keystone.service[81418]: [pid: 81418|app: 0|req: 1481/2962] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Sep 19 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 12:15:18.484267 dv-cinder-858293-1-smb devstack@keystone.service[81418]: DEBUG dbcounter [-] [81418] Writing DB stats keystone:SELECT=67 {{(pid=81418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}